02/10/2025 00:46:46.864 7f385fe4be08 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 02/10/2025 00:46:46.864 7f385fe4be08 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 02/10/2025 00:46:46.864 7f385fe4be08 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 02/10/2025 00:46:46.864 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.17:2181,10.0.0.12:2181,10.0.0.30:2181 02/10/2025 00:46:46.865 7f385fe4be08 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 00:46:46.865 7f3856bd8f60 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 02/10/2025 00:46:46.865 7f3856bd8f60 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.866 7f3856bdc8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.867 7f3856bdc8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:46:46.867 7f3856bdc8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.867 7f3856bdc8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.867 7f3856bdc8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 02/10/2025 00:46:46.867 7f3856bdc8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.873 7f3856c02240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:46.873 7f3856c02240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:46:46.873 7f3856c02240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:50.870 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:46:50.871 7f3856ba2c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:46:50.871 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:46:50.871 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:50.871 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:46:50.871 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:46:50.872 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:54.875 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:46:54.876 7f3856ba2c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:46:54.877 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:54.878 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:46:54.878 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:54.878 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:54.878 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:46:54.878 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:58.880 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:46:58.881 7f3856ba2c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:46:58.881 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:46:58.881 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:58.881 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:46:58.881 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:46:58.882 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:02.883 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:02.885 7f3856ba2c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:02.886 7f3856ba2c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.517 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.17:9041', '10.0.0.12:9041', '10.0.0.30:9041'] 02/10/2025 00:47:06.517 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 02/10/2025 00:47:06.517 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 00:47:06.517 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 00:47:06.518 7f3856ba2438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.518 7f3856ba2438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:06.518 7f3856ba2438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.519 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 00:47:06.562 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 00:47:06.564 7f3856bc8780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.564 7f3856bc8780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:06.564 7f3856bc8780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.573 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 00:47:06.573 7f3856bc8588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.573 7f3856bc8588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:06.574 7f3856bc8588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.585 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 00:47:06.629 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 00:47:06.629 7f3856ac68d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.630 7f3856ac68d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:06.630 7f3856ac68d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.748 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.17:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.30:5673//'] 02/10/2025 00:47:06.756 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:06.757 7f385615dc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.760 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 02/10/2025 00:47:06.761 7f38561f48d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.761 7f38561f48d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:06.761 7f38561f48d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.785 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 02/10/2025 00:47:06.786 7f3856175e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.786 7f3856175e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:06.786 7f3856175e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.790 7f385fe4be08 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 02/10/2025 00:47:06.790 7f38561f4198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.790 7f38561f4198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:06.790 7f38561f4198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.791 7f3856175438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 02/10/2025 00:47:06.792 7f38560ac8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.792 7f38560ac8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:06.792 7f38560ac8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.801 7f3856175438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 02/10/2025 00:47:06.801 7f38560ae6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.801 7f38560ae6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:06.801 7f38560ae6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.886 7f3859bc8198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:06.888 7f3859bc8198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.889 7f3859bc8198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:06.889 7f3859bc8198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.889 7f3859bc8198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:06.889 7f3859bc8198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148406866510 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.17:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:06.889 7f3859bc8198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.409 7fe24b2c0f88 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 02/10/2025 00:47:16.409 7fe24b2c0f88 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 02/10/2025 00:47:16.409 7fe24b2c0f88 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 02/10/2025 00:47:16.409 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.17:2181,10.0.0.12:2181,10.0.0.30:2181 02/10/2025 00:47:16.410 7fe24b2c0f88 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 00:47:16.411 7fe2420d4eb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 02/10/2025 00:47:16.411 7fe2420d4eb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 02/10/2025 00:47:16.411 7fe2420d8828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 02/10/2025 00:47:16.412 7fe2420d8828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 00:47:16.412 7fe2420d8828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 02/10/2025 00:47:16.412 7fe2420d8828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 02/10/2025 00:47:16.413 7fe2420d8828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.427 7fe2420fe198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.427 7fe2420fe198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.427 7fe2420fe198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.507 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.17:9041', '10.0.0.12:9041', '10.0.0.30:9041'] 02/10/2025 00:47:16.507 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 02/10/2025 00:47:16.507 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 00:47:16.507 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 00:47:16.508 7fe2420a0828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.508 7fe2420a0828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:16.508 7fe2420a0828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.509 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 00:47:16.544 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 00:47:16.548 7fe2420c0240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.548 7fe2420c0240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:16.548 7fe2420c0240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.553 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 00:47:16.554 7fe24208f8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.554 7fe24208f8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 00:47:16.554 7fe24208f8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.571 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 00:47:16.653 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 00:47:16.654 7fe241f55d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.654 7fe241f55d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.654 7fe241f55d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.736 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.17:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.30:5673//'] 02/10/2025 00:47:16.744 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:16.745 7fe2416796d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.749 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 02/10/2025 00:47:16.749 7fe241679b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.749 7fe241679b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.749 7fe241679b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.796 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 02/10/2025 00:47:16.797 7fe2415beeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.797 7fe2415beeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:16.797 7fe2415beeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.802 7fe24b2c0f88 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 02/10/2025 00:47:16.802 7fe2415beeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.803 7fe2415beeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.803 7fe2415beeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.804 7fe241679588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 02/10/2025 00:47:16.805 7fe2414f9198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.805 7fe2414f9198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/10/2025 00:47:16.805 7fe2414f9198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.809 7fe241679588 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 02/10/2025 00:47:16.810 7fe2414f9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:16.810 7fe2414f9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 00:47:16.810 7fe2414f9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.007 7fe248d42630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.17_0 02/10/2025 00:47:17.007 7fe248d42630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly-r24.1-centos) 02/10/2025 00:47:17.026 7fe248d42630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (nightly-r24.1-centos) 02/10/2025 00:47:17.040 7fe248d42630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running walk 02/10/2025 00:47:17.059 7fe248d42630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 02/10/2025 00:47:17.085 7fe248d42630 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Time elapsed in resyncing db: 0:00:00.076647 02/10/2025 00:47:17.089 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'obj_dict': {'display_name': 'Node Profile', 'fq_name': ['default-global-system-config', 'node_profile_template'], 'id_perms': {'created': '2025-02-10T00:47:16.889455', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:16.889455', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11925890044662613214, 'uuid_mslong': 3501750976997575122}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Node Profile Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command Hostname/IP", "type": ' '"string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/node_profile.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3098b7f5-e3d1-49d2-a581-45cf3e7b84de'}, 'oper': 'CREATE', 'request-id': 'req-ef06fb8a-ffe9-4f2f-bdf2-8206d361e3e8', 'type': 'job_template', 'uuid': '3098b7f5-e3d1-49d2-a581-45cf3e7b84de'} 02/10/2025 00:47:17.090 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-a126d361-61a7-4356-9db2-7e6ee4fbbb7b', 'type': 'application_policy_set', 'uuid': 'e6302dd6-2f1e-4680-9e0d-f0754a1af492'} 02/10/2025 00:47:17.099 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 02/10/2025 00:47:17.100 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-b6126fe4-fa22-47d6-bcba-3b37d1686d19', 'type': 'network_ipam', 'uuid': '3286a621-cbde-439f-aabc-a278a3a37562'} 02/10/2025 00:47:17.105 7fe24c9e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.106 7fe24c9e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16586807825542301312, "uuid_lslong": 11389023419234972818}, "enable": true, "created": "2025-02-10T00:47:06.845253", "last_modified": "2025-02-10T00:47:16.885301", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "738e6780-acdb-4be3-864b-c371a1483e5d"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "e6302dd6-2f1e-4680-9e0d-f0754a1af492" } deleted = False >> 02/10/2025 00:47:17.107 7fe24c9e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.115 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-491278fd-906c-4ac2-a93f-88e9a2201a04', 'type': 'project', 'uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7'} 02/10/2025 00:47:17.121 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 02/10/2025 00:47:17.122 7fe241f50cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.123 7fe241f50cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4154317383801457939, "uuid_lslong": 13121576981560452039}, "enable": true, "created": "2025-02-10T00:47:06.677104", "last_modified": "2025-02-10T00:47:17.077966", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "d8f2d64d-74c7-40f3-b08b-c31f6d4f1e8c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "39a719a6-69b7-4d13-b619-34be5eda63c7" } deleted = False >> 02/10/2025 00:47:17.124 7fe241f50cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.365 7fe24b2c0f88 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 02/10/2025 00:47:17.366 7fe24895f6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.367 7fe24895f6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ModuleCpuStateTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-02-06 00:34:07.638899", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7691-1.novalocal", "build-id" : "1", "build-number" : "centos"}]} config_node_ip = [ 10.0.0.17, 10.20.0.11, 172.17.0.1, ] >> 02/10/2025 00:47:17.367 7fe24895f6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.489 7fe2413ce0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.489 7fe2413ce0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Generic Connection:Keystone[] connection down >>, ] >> 02/10/2025 00:47:17.489 7fe2413ce0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.511 7fe241f96cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting consumer greenlet 02/10/2025 00:47:17.511 7fe241f96cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 02/10/2025 00:47:17.512 7fe241f96780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting publisher greenlet 02/10/2025 00:47:17.512 7fe241f96780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Publisher connection 02/10/2025 00:47:17.513 7fe24b2c0f88 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy 02/10/2025 00:47:17.513 7fe24b2c0f88 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 00:47:17.515 7fe2438de588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.515 7fe2438de588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = http://10.0.0.17:8084 >> 02/10/2025 00:47:17.515 7fe2438de588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:17.522 7fe241f96780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 02/10/2025 00:47:17.523 7fe241f96cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 02/10/2025 00:47:17.556 7fe241f96cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy'] 02/10/2025 00:47:17.569 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-6022b94c-5b7b-47c8-a5c1-15c380da7656', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:17.583 7fe241f96cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 02/10/2025 00:47:17.598 7fe241f96cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 02/10/2025 00:47:17.699 7fe241f96cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy'] 02/10/2025 00:47:19.710 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'obj_dict': {'display_name': 'Show mac mobility', 'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'id_perms': {'created': '2025-02-10T00:47:19.686325', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:19.686325', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10063294099260089557, 'uuid_mslong': 16204574171959083120}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display MAC ' 'address move or mobility', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"mac_details": ' '{"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "MAC Details", "type": ' '"object", "properties": ' '{"mac_address": {"$id": ' '"/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}, "required": ' '["mac_address"]}}}', 'job_template_input_ui_schema': '{"mac_details": {"mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show MAC mobility ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "MAC History", ' '"description": "Display Device ' 'Configuration output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e0e2365a-9817-4070-8ba8-00aa68aea4d5'}, 'oper': 'CREATE', 'request-id': 'req-a84ed30b-35a6-4725-9d98-7c0cbfdb4a2d', 'type': 'job_template', 'uuid': 'e0e2365a-9817-4070-8ba8-00aa68aea4d5'} 02/10/2025 00:47:19.789 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'obj_dict': {'config_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'id_perms': {'created': '2025-02-10T00:47:19.776496', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:19.776496', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10354127422646921512, 'uuid_mslong': 5001260731885307495}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '45680c23-4922-4667-8fb1-40084a002928'}, 'oper': 'CREATE', 'request-id': 'req-c648ff1e-9db7-416c-bef1-c567028ebe1b', 'type': 'config_node', 'uuid': '45680c23-4922-4667-8fb1-40084a002928'} 02/10/2025 00:47:19.789 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:47:19.790 7fe2411d2828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:19.790 7fe2411d2828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3. elements = { config_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 5001260731885307495, "uuid_lslong": 10354127422646921512}, "enable": true, "created": "2025-02-10T00:47:19.776496", "last_modified": "2025-02-10T00:47:19.776496", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "45680c23-4922-4667-8fb1-40084a002928" } deleted = False >> 02/10/2025 00:47:19.790 7fe2411d2828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:19.871 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'obj_dict': {'config_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'id_perms': {'created': '2025-02-10T00:47:19.857770', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:19.857770', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9283668021701371507, 'uuid_mslong': 13675936756819313807}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bdcab005-a8ec-448f-80d6-36e0f629e673'}, 'oper': 'CREATE', 'request-id': 'req-00960a2d-3828-4b07-a0b6-6053089da2a8', 'type': 'config_node', 'uuid': 'bdcab005-a8ec-448f-80d6-36e0f629e673'} 02/10/2025 00:47:19.872 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:47:19.872 7fe2411e14e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:19.872 7fe2411e14e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2. elements = { config_node_ip_address : "10.0.0.12"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13675936756819313807, "uuid_lslong": 9283668021701371507}, "enable": true, "created": "2025-02-10T00:47:19.857770", "last_modified": "2025-02-10T00:47:19.857770", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "bdcab005-a8ec-448f-80d6-36e0f629e673" } deleted = False >> 02/10/2025 00:47:19.872 7fe2411e14e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:20.413 7fe2409a78d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:20.414 7fe2409a78d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:20.414 7fe2409a78d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:20.414 7fe2409a78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:20.414 7fe2409a78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:20.415 7fe2409a78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:21.384 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:rma_activate_template url = http://10.0.0.17:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "rma_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/rma_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 3}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"RMA activate\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"rma_devices\": {\"type\": \"array\", \"items\": {\"title\": \"RMA Devices\", \"type\": \"object\", \"description\": \"List of devices and corresponding serial numbers to RMA\", \"additionalProperties\": false, \"properties\": {\"device_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}, \"serial_number\": {\"type\": \"string\"}}, \"required\": [\"device_uuid\", \"serial_number\"]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "RMA Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.440 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.506 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'obj_dict': {'display_name': 'RMA Activation', 'fq_name': ['default-global-system-config', 'rma_activate_template'], 'id_perms': {'created': '2025-02-10T00:47:21.436036', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.436036', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12930071392598215353, 'uuid_mslong': 5283684081067904351}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "RMA activate", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "rma_devices": ' '{"type": "array", "items": ' '{"title": "RMA Devices", "type": ' '"object", "description": "List of ' 'devices and corresponding serial ' 'numbers to RMA", ' '"additionalProperties": false, ' '"properties": {"device_uuid": ' '{"type": "string", "format": ' '"uuid"}, "serial_number": {"type": ' '"string"}}, "required": ' '["device_uuid", ' '"serial_number"]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/rma_activate.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '49536aad-7570-4d5f-b370-d76cd441cab9'}, 'oper': 'CREATE', 'request-id': 'req-7209ea9d-d4de-4fa4-928b-9d346e4efe64', 'type': 'job_template', 'uuid': '49536aad-7570-4d5f-b370-d76cd441cab9'} 02/10/2025 00:47:21.521 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-02-10T00:47:21.490530', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-02-10T00:47:21.490530', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12167164034027906895, 'uuid_mslong': 3067964576659818032}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2a939987-174a-4630-a8da-73397c24674f', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e7040172-2585-49b3-b65b-24dfe3b82d79', 'type': 'alarm', 'uuid': '2a939987-174a-4630-a8da-73397c24674f'} 02/10/2025 00:47:21.542 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.575 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'obj_dict': {'display_name': 'Show chassis information', 'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'id_perms': {'created': '2025-02-10T00:47:21.566474', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.566474', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10450417843573511743, 'uuid_mslong': 3236965253271210031}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'chassis information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"chassis": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Chassis information", ' '"type": "object", "properties": ' '{"chassis_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis hardware"}}, ' '"required": ["chassis_detail"]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2cec02bf-6783-482f-9107-57a8f89a563f'}, 'oper': 'CREATE', 'request-id': 'req-485d8e6c-2910-4f47-bad6-3232cbae3ae3', 'type': 'job_template', 'uuid': '2cec02bf-6783-482f-9107-57a8f89a563f'} 02/10/2025 00:47:21.599 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-02-10T00:47:21.586509', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-02-10T00:47:21.586509', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12994183728751609301, 'uuid_mslong': 10993304510676353895}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98901035-1a90-4367-b454-9d41526685d5', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-26a66133-dc35-4efb-8eb3-1eec3e978101', 'type': 'alarm', 'uuid': '98901035-1a90-4367-b454-9d41526685d5'} 02/10/2025 00:47:21.668 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.678 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'obj_dict': {'display_name': 'Fetch hardware chassis information', 'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'id_perms': {'created': '2025-02-10T00:47:21.651543', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.651543', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11193005826331445968, 'uuid_mslong': 11103829414166154806}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to fetch ' 'hardware inventory information from ' 'the device', 'job_template_input_schema': '{"title": "Hardware Inventory ' 'Information", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", "minProperties": ' '1}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9a18ba05-85e8-4e36-9b55-8b7ef75d0ad0'}, 'oper': 'CREATE', 'request-id': 'req-294a3288-2203-44f8-8aea-bfaf84ec7e77', 'type': 'job_template', 'uuid': '9a18ba05-85e8-4e36-9b55-8b7ef75d0ad0'} 02/10/2025 00:47:21.712 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_properties identifier_name = default-global-system-config:config_property url = http://10.0.0.17:8082/config-propertiess operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"config-properties": {"uuid": null, "fq_name": ["default-global-system-config", "config_property"], "parent_type": "global-system-config", "properties": {"key_value_pair": [{"key": "junos_commit_timeout", "value": "600"}, {"key": "total_retry_timeout", "value": "600"}, {"key": "device_command_timeout", "value": "600"}, {"key": "ztp_timeout", "value": "570"}]}, "display_name": "Config Property", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.747 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-02-10T00:47:21.724987', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-02-10T00:47:21.724987', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13050594606180144150, 'uuid_mslong': 787696927268293495}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-984cf01b-a535-4acd-b61c-b2887be54019', 'type': 'alarm', 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416'} 02/10/2025 00:47:21.776 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'obj_dict': {'display_name': 'Config Property', 'fq_name': ['default-global-system-config', 'config_property'], 'id_perms': {'created': '2025-02-10T00:47:21.767050', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.767050', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11286858795291464362, 'uuid_mslong': 13240905118595895272}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'properties': {'key_value_pair': [{'key': 'junos_commit_timeout', 'value': '600'}, {'key': 'total_retry_timeout', 'value': '600'}, {'key': 'device_command_timeout', 'value': '600'}, {'key': 'ztp_timeout', 'value': '570'}]}, 'uuid': 'b7c1250d-528f-4fe8-9ca2-fa46235752aa'}, 'oper': 'CREATE', 'request-id': 'req-39de499b-a343-443c-893e-fa05ea767646', 'type': 'config_properties', 'uuid': 'b7c1250d-528f-4fe8-9ca2-fa46235752aa'} 02/10/2025 00:47:21.817 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:21.887 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-02-10T00:47:21.872648', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-02-10T00:47:21.872648', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11359386989230308562, 'uuid_mslong': 106030899773260730}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-f4df1c77-afb2-4a2e-86aa-8d4b370d36df', 'type': 'alarm', 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2'} 02/10/2025 00:47:21.921 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-management-ip'], 'obj_dict': {'display_name': 'label=fabric-management-ip', 'fq_name': ['label=fabric-management-ip'], 'id_perms': {'created': '2025-02-10T00:47:21.888965', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.888965', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12523240332443784995, 'uuid_mslong': 1539459023125563116}}, 'name': 'label=fabric-management-ip', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000000', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-management-ip', 'uuid': '155d41d3-3bab-46ec-adcb-7cbb3c281723'}, 'oper': 'CREATE', 'request-id': 'req-b9c1447e-20ef-4364-bf1b-805edd87ae77', 'type': 'tag', 'uuid': '155d41d3-3bab-46ec-adcb-7cbb3c281723'} 02/10/2025 00:47:21.922 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:21.922 7fe2409864e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:21.922 7fe2409864e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-management-ip elements = { display_name : "label=fabric-management-ip"fq_name : ["label=fabric-management-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1539459023125563116, "uuid_lslong": 12523240332443784995}, "enable": true, "created": "2025-02-10T00:47:21.888965", "last_modified": "2025-02-10T00:47:21.888965", "description": null, "user_visible": true, "creator": null}name : "label=fabric-management-ip"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000000"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-management-ip"uuid : "155d41d3-3bab-46ec-adcb-7cbb3c281723" } deleted = False >> 02/10/2025 00:47:21.922 7fe2409864e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:21.956 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.015 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-02-10T00:47:22.005530', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.005530', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12381572976898382545, 'uuid_mslong': 1864598981181525371}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-b854d77a-496a-4f7a-9b79-28bcda0742cc', 'type': 'alarm', 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1'} 02/10/2025 00:47:22.029 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-loopback-ip', 'fq_name': ['label=fabric-loopback-ip'], 'id_perms': {'created': '2025-02-10T00:47:21.991228', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:21.991228', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10672018270092931182, 'uuid_mslong': 1032836815477031322}}, 'name': 'label=fabric-loopback-ip', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000001', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-loopback-ip', 'uuid': '0e555f9c-8974-419a-941a-a012e95e306e'}, 'oper': 'CREATE', 'request-id': 'req-c48cc112-c33c-4055-822c-567e62af6391', 'type': 'tag', 'uuid': '0e555f9c-8974-419a-941a-a012e95e306e'} 02/10/2025 00:47:22.030 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.030 7fe2413404e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.031 7fe2413404e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-loopback-ip elements = { display_name : "label=fabric-loopback-ip"fq_name : ["label=fabric-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1032836815477031322, "uuid_lslong": 10672018270092931182}, "enable": true, "created": "2025-02-10T00:47:21.991228", "last_modified": "2025-02-10T00:47:21.991228", "description": null, "user_visible": true, "creator": null}name : "label=fabric-loopback-ip"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000001"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-loopback-ip"uuid : "0e555f9c-8974-419a-941a-a012e95e306e" } deleted = False >> 02/10/2025 00:47:22.031 7fe2413404e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.060 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-overlay-loopback-ip url = http://10.0.0.17:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-overlay-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-overlay-loopback-ip", "tag_predefined": true, "name": "label=fabric-overlay-loopback-ip", "display_name": "label=fabric-overlay-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.093 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.152 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-02-10T00:47:22.141574', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.141574', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11737538067620195742, 'uuid_mslong': 14742271549931210745}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-b77d00fb-df42-4275-b06d-db2f5dc016ae', 'type': 'alarm', 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e'} 02/10/2025 00:47:22.197 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-overlay-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-overlay-loopback-ip', 'fq_name': ['label=fabric-overlay-loopback-ip'], 'id_perms': {'created': '2025-02-10T00:47:22.094862', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.094862', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9790201520327590298, 'uuid_mslong': 1694802550517157173}}, 'name': 'label=fabric-overlay-loopback-ip', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000002', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-overlay-loopback-ip', 'uuid': '178525f0-b400-4d35-87dd-c8697a9d819a'}, 'oper': 'CREATE', 'request-id': 'req-d0684866-6f36-4b96-a480-6837adb9c97e', 'type': 'tag', 'uuid': '178525f0-b400-4d35-87dd-c8697a9d819a'} 02/10/2025 00:47:22.198 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.198 7fe2409a74e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.198 7fe2409a74e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-overlay-loopback-ip elements = { display_name : "label=fabric-overlay-loopback-ip"fq_name : ["label=fabric-overlay-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1694802550517157173, "uuid_lslong": 9790201520327590298}, "enable": true, "created": "2025-02-10T00:47:22.094862", "last_modified": "2025-02-10T00:47:22.094862", "description": null, "user_visible": true, "creator": null}name : "label=fabric-overlay-loopback-ip"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000002"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-overlay-loopback-ip"uuid : "178525f0-b400-4d35-87dd-c8697a9d819a" } deleted = False >> 02/10/2025 00:47:22.198 7fe2409a74e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.248 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.301 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-02-10T00:47:22.292608', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.292608', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10640533740384563780, 'uuid_mslong': 9723743499081302856}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e00d59a8-4440-4e1d-9660-a5dceed66cb4', 'type': 'alarm', 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244'} 02/10/2025 00:47:22.355 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-peer-ip'], 'obj_dict': {'display_name': 'label=fabric-peer-ip', 'fq_name': ['label=fabric-peer-ip'], 'id_perms': {'created': '2025-02-10T00:47:22.319847', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.319847', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12368493029899477513, 'uuid_mslong': 1511179384107974786}}, 'name': 'label=fabric-peer-ip', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000003', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-peer-ip', 'uuid': '14f8c9a4-ada6-4082-aba5-b6e12e0da209'}, 'oper': 'CREATE', 'request-id': 'req-6a45b763-4429-4856-86a7-e51954c52564', 'type': 'tag', 'uuid': '14f8c9a4-ada6-4082-aba5-b6e12e0da209'} 02/10/2025 00:47:22.356 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.358 7fe240946048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.358 7fe240946048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-peer-ip elements = { display_name : "label=fabric-peer-ip"fq_name : ["label=fabric-peer-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1511179384107974786, "uuid_lslong": 12368493029899477513}, "enable": true, "created": "2025-02-10T00:47:22.319847", "last_modified": "2025-02-10T00:47:22.319847", "description": null, "user_visible": true, "creator": null}name : "label=fabric-peer-ip"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000003"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-peer-ip"uuid : "14f8c9a4-ada6-4082-aba5-b6e12e0da209" } deleted = False >> 02/10/2025 00:47:22.358 7fe240946048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.359 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.418 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-02-10T00:47:22.409429', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.409429', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9590349815219405692, 'uuid_mslong': 10830390048126025743}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a34c286d-fbf1-416b-b21d-57301bb039ea', 'type': 'alarm', 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c'} 02/10/2025 00:47:22.472 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-pnf-servicechain-ip'], 'obj_dict': {'display_name': 'label=fabric-pnf-servicechain-ip', 'fq_name': ['label=fabric-pnf-servicechain-ip'], 'id_perms': {'created': '2025-02-10T00:47:22.406739', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.406739', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11256510955504317379, 'uuid_mslong': 283275806663855695}}, 'name': 'label=fabric-pnf-servicechain-ip', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000004', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-pnf-servicechain-ip', 'uuid': '03ee65d8-65a9-4e4f-9c37-29131120b3c3'}, 'oper': 'CREATE', 'request-id': 'req-9d042207-c3a3-490e-b6eb-fb58639787f5', 'type': 'tag', 'uuid': '03ee65d8-65a9-4e4f-9c37-29131120b3c3'} 02/10/2025 00:47:22.472 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.473 7fe240920198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.473 7fe240920198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-pnf-servicechain-ip elements = { display_name : "label=fabric-pnf-servicechain-ip"fq_name : ["label=fabric-pnf-servicechain-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 283275806663855695, "uuid_lslong": 11256510955504317379}, "enable": true, "created": "2025-02-10T00:47:22.406739", "last_modified": "2025-02-10T00:47:22.406739", "description": null, "user_visible": true, "creator": null}name : "label=fabric-pnf-servicechain-ip"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000004"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-pnf-servicechain-ip"uuid : "03ee65d8-65a9-4e4f-9c37-29131120b3c3" } deleted = False >> 02/10/2025 00:47:22.473 7fe240920198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.491 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-as-number url = http://10.0.0.17:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-as-number"], "tag_type_name": "label", "tag_value": "fabric-as-number", "tag_predefined": true, "name": "label=fabric-as-number", "display_name": "label=fabric-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.500 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.548 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-02-10T00:47:22.541706', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.541706', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13656770065927497359, 'uuid_mslong': 6834040248837950101}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-6bf0ef06-1288-43ba-8b43-a5c0e854a7b9', 'type': 'alarm', 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f'} 02/10/2025 00:47:22.579 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-as-number'], 'obj_dict': {'display_name': 'label=fabric-as-number', 'fq_name': ['label=fabric-as-number'], 'id_perms': {'created': '2025-02-10T00:47:22.537172', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.537172', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11171088104938175088, 'uuid_mslong': 1331654547322193247}}, 'name': 'label=fabric-as-number', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000005', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-as-number', 'uuid': '127afcc1-60ac-455f-9b07-ad71c96e7a70'}, 'oper': 'CREATE', 'request-id': 'req-5e01bb88-8995-4d4a-887f-e568135bf631', 'type': 'tag', 'uuid': '127afcc1-60ac-455f-9b07-ad71c96e7a70'} 02/10/2025 00:47:22.579 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.580 7fe2409810f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.580 7fe2409810f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-as-number elements = { display_name : "label=fabric-as-number"fq_name : ["label=fabric-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1331654547322193247, "uuid_lslong": 11171088104938175088}, "enable": true, "created": "2025-02-10T00:47:22.537172", "last_modified": "2025-02-10T00:47:22.537172", "description": null, "user_visible": true, "creator": null}name : "label=fabric-as-number"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000005"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-as-number"uuid : "127afcc1-60ac-455f-9b07-ad71c96e7a70" } deleted = False >> 02/10/2025 00:47:22.580 7fe2409810f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.602 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.671 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-02-10T00:47:22.646371', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.646371', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13676640507246752735, 'uuid_mslong': 17223357321572205820}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-696501d4-4c51-437d-843e-b8fba96f50d4', 'type': 'alarm', 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df'} 02/10/2025 00:47:22.682 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-ebgp-as-number'], 'obj_dict': {'display_name': 'label=fabric-ebgp-as-number', 'fq_name': ['label=fabric-ebgp-as-number'], 'id_perms': {'created': '2025-02-10T00:47:22.648143', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.648143', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10160213140377888012, 'uuid_mslong': 7652702549529937839}}, 'name': 'label=fabric-ebgp-as-number', 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000006', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'be7faf5f-30ac-40ec-95c4-d74cb5331742'}], 'tag_value': 'fabric-ebgp-as-number', 'uuid': '6a33dc6c-4c75-47af-8d00-5405227ae50c'}, 'oper': 'CREATE', 'request-id': 'req-4f0027c4-1d1b-456e-ac7c-b10f7be9587f', 'type': 'tag', 'uuid': '6a33dc6c-4c75-47af-8d00-5405227ae50c'} 02/10/2025 00:47:22.683 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:47:22.683 7fe2409532e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.683 7fe2409532e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-ebgp-as-number elements = { display_name : "label=fabric-ebgp-as-number"fq_name : ["label=fabric-ebgp-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7652702549529937839, "uuid_lslong": 10160213140377888012}, "enable": true, "created": "2025-02-10T00:47:22.648143", "last_modified": "2025-02-10T00:47:22.648143", "description": null, "user_visible": true, "creator": null}name : "label=fabric-ebgp-as-number"perms2 : {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000006"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "be7faf5f-30ac-40ec-95c4-d74cb5331742", "to": ["label"]}]tag_value : "fabric-ebgp-as-number"uuid : "6a33dc6c-4c75-47af-8d00-5405227ae50c" } deleted = False >> 02/10/2025 00:47:22.684 7fe2409532e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:22.717 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-3617e313-2b1d-4a16-8b35-55fb64facd2f', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:47:22.726 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.761 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-02-10T00:47:22.752094', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-02-10T00:47:22.752094', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9262199463290372215, 'uuid_mslong': 2473618296414817383}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a7d3edd4-923e-4015-800b-5dd3afb32786', 'type': 'alarm', 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077'} 02/10/2025 00:47:22.768 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afi"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.799 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afi', 'fq_name': ['juniper-qfx5100-48sh-afi'], 'id_perms': {'created': '2025-02-10T00:47:22.780435', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.780435', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12709984105162216504, 'uuid_mslong': 3627787373648691901}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '32587d65-3efa-42bd-b062-ef34090e1438'}, 'oper': 'CREATE', 'request-id': 'req-d256fe3e-9889-4859-af23-00032669ea7e', 'type': 'hardware', 'uuid': '32587d65-3efa-42bd-b062-ef34090e1438'} 02/10/2025 00:47:22.824 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.883 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afo', 'fq_name': ['juniper-qfx5100-48sh-afo'], 'id_perms': {'created': '2025-02-10T00:47:22.858979', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.858979', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12938795424569275566, 'uuid_mslong': 6717680873102592052}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '5d39ff29-8bb7-4834-b38f-d5e2cee6b4ae'}, 'oper': 'CREATE', 'request-id': 'req-9057dfef-e988-42c5-96f4-d4034df4902d', 'type': 'hardware', 'uuid': '5d39ff29-8bb7-4834-b38f-d5e2cee6b4ae'} 02/10/2025 00:47:22.908 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-02-10T00:47:22.896791', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-02-10T00:47:22.896791', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13249769476795977335, 'uuid_mslong': 8891776799779407672}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-ce91e903-71ec-4141-8c59-8d4d2d0ed4e5', 'type': 'alarm', 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77'} 02/10/2025 00:47:22.914 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afi', 'fq_name': ['juniper-qfx5100-48th-afi'], 'id_perms': {'created': '2025-02-10T00:47:22.902555', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.902555', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12420012360617707290, 'uuid_mslong': 8932916885764917539}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '7bf81894-381b-4923-ac5c-bf701c94471a'}, 'oper': 'CREATE', 'request-id': 'req-4187cd83-019b-4be5-8c34-a4ea6f344c02', 'type': 'hardware', 'uuid': '7bf81894-381b-4923-ac5c-bf701c94471a'} 02/10/2025 00:47:22.970 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afo"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:22.980 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.007 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afo', 'fq_name': ['juniper-qfx5100-48th-afo'], 'id_perms': {'created': '2025-02-10T00:47:22.986252', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:22.986252', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12288666353225522265, 'uuid_mslong': 15711623557063985520}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'da0ae661-a375-4970-aa8a-1cf0ab4d5c59'}, 'oper': 'CREATE', 'request-id': 'req-c6ef54a7-7d83-4c3f-bc56-1fd4acb27afc', 'type': 'hardware', 'uuid': 'da0ae661-a375-4970-aa8a-1cf0ab4d5c59'} 02/10/2025 00:47:23.036 7fe241288cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:23.036 7fe241288cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:23.036 7fe241288cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:23.052 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-02-10T00:47:23.039896', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-02-10T00:47:23.039896', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9602350335095076031, 'uuid_mslong': 13955837365055538194}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-73cc4e9b-210f-4b92-8831-506809de8062', 'type': 'alarm', 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf'} 02/10/2025 00:47:23.064 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48s-6q', 'fq_name': ['juniper-qfx5100-48s-6q'], 'id_perms': {'created': '2025-02-10T00:47:23.037761', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.037761', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9831136250607308470, 'uuid_mslong': 16369455567260173567}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'e32bfd1b-fd15-44ff-886f-365513ea0eb6'}, 'oper': 'CREATE', 'request-id': 'req-8bb420e0-9e76-41db-883f-a51b6da2b92a', 'type': 'hardware', 'uuid': 'e32bfd1b-fd15-44ff-886f-365513ea0eb6'} 02/10/2025 00:47:23.116 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.119 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100-96s-8q', 'fq_name': ['juniper-qfx5100-96s-8q'], 'id_perms': {'created': '2025-02-10T00:47:23.094517', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.094517', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9739372978309402001, 'uuid_mslong': 4916629033307685567}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '443b600e-6ead-42bf-8729-341f532b8d91'}, 'oper': 'CREATE', 'request-id': 'req-372c6910-4833-495e-9e1c-f62abc024944', 'type': 'hardware', 'uuid': '443b600e-6ead-42bf-8729-341f532b8d91'} 02/10/2025 00:47:23.136 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.166 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-02-10T00:47:23.149840', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.149840', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12208324291897264860, 'uuid_mslong': 8010917881099994693}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-e86dad59-61f0-4e7c-bd6f-96ba028a4d7f', 'type': 'alarm', 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc'} 02/10/2025 00:47:23.178 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t', 'fq_name': ['juniper-qfx5100-48t'], 'id_perms': {'created': '2025-02-10T00:47:23.145936', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.145936', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12031573126956398856, 'uuid_mslong': 17433749545843576740}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'f1f11ed8-0f22-4fa4-a6f8-bc03515f3908'}, 'oper': 'CREATE', 'request-id': 'req-c07e9b99-dbeb-4fd5-8809-38bb83d879bf', 'type': 'hardware', 'uuid': 'f1f11ed8-0f22-4fa4-a6f8-bc03515f3908'} 02/10/2025 00:47:23.207 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t-6q', 'fq_name': ['juniper-qfx5100-48t-6q'], 'id_perms': {'created': '2025-02-10T00:47:23.196951', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.196951', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10613393856088823967, 'uuid_mslong': 5510549194900851492}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '4c79674b-ef61-4b24-934a-597add7cd89f'}, 'oper': 'CREATE', 'request-id': 'req-acb1880a-f282-42a6-9f43-0f75d115a555', 'type': 'hardware', 'uuid': '4c79674b-ef61-4b24-934a-597add7cd89f'} 02/10/2025 00:47:23.219 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.281 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-02-10T00:47:23.272344', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.272344', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9601528993555656563, 'uuid_mslong': 8955135509161722690}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-023c38d1-6566-46b0-8c91-39bbb22057d2', 'type': 'alarm', 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73'} 02/10/2025 00:47:23.305 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-2p', 'fq_name': ['juniper-qfx5100-24q-2p'], 'id_perms': {'created': '2025-02-10T00:47:23.296511', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.296511', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12225562377013995345, 'uuid_mslong': 14927328251106512209}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'cf2885f4-bcdb-4d51-a9a9-ec35454ca751'}, 'oper': 'CREATE', 'request-id': 'req-f7701f76-c070-47b3-860c-0b57328a1c6c', 'type': 'hardware', 'uuid': 'cf2885f4-bcdb-4d51-a9a9-ec35454ca751'} 02/10/2025 00:47:23.327 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-aa"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-aa"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.344 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.356 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-aa', 'fq_name': ['juniper-qfx5100-24q-aa'], 'id_perms': {'created': '2025-02-10T00:47:23.339603', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.339603', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11016324118874695850, 'uuid_mslong': 11330380018570118642}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '9d3d9898-910e-45f2-98e1-d86b4c1828aa'}, 'oper': 'CREATE', 'request-id': 'req-b56d42a2-2669-4895-ad08-6583f55e8e03', 'type': 'hardware', 'uuid': '9d3d9898-910e-45f2-98e1-d86b4c1828aa'} 02/10/2025 00:47:23.408 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48s-6q', 'fq_name': ['juniper-qfx5100e-48s-6q'], 'id_perms': {'created': '2025-02-10T00:47:23.384488', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.384488', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12834559342099223941, 'uuid_mslong': 2693279222591865204}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '2560732e-ef87-4174-b21d-83b8a27ed585'}, 'oper': 'CREATE', 'request-id': 'req-e69ad270-27aa-4ac1-89a9-b77a99928973', 'type': 'hardware', 'uuid': '2560732e-ef87-4174-b21d-83b8a27ed585'} 02/10/2025 00:47:23.417 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-02-10T00:47:23.404201', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.404201', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9343812582386953275, 'uuid_mslong': 17957929674153019633}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-dce826db-e3ca-4a5f-a493-772a60c3301a', 'type': 'alarm', 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b'} 02/10/2025 00:47:23.448 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-96s-8q', 'fq_name': ['juniper-qfx5100e-96s-8q'], 'id_perms': {'created': '2025-02-10T00:47:23.436287', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.436287', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10340759123710725283, 'uuid_mslong': 16370985468631796704}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'e3316c8b-e8e1-4be0-8f81-c1a2a4a84ca3'}, 'oper': 'CREATE', 'request-id': 'req-1285e49e-79bf-4d32-a883-40c0537646d7', 'type': 'hardware', 'uuid': 'e3316c8b-e8e1-4be0-8f81-c1a2a4a84ca3'} 02/10/2025 00:47:23.455 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48t-6q"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.489 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.511 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48t-6q', 'fq_name': ['juniper-qfx5100e-48t-6q'], 'id_perms': {'created': '2025-02-10T00:47:23.466547', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.466547', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11399926083234242634, 'uuid_mslong': 9718484885630699678}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '86defe83-4305-489e-9e34-ac5f90e3204a'}, 'oper': 'CREATE', 'request-id': 'req-977a0a75-fdc1-44a5-8245-5ebbed410139', 'type': 'hardware', 'uuid': '86defe83-4305-489e-9e34-ac5f90e3204a'} 02/10/2025 00:47:23.564 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-02-10T00:47:23.554382', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-02-10T00:47:23.554382', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12523167171063957536, 'uuid_mslong': 17830229414401098866}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-3ae7d84f-58f5-4981-9e8a-63c527bfee24', 'type': 'alarm', 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820'} 02/10/2025 00:47:23.581 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100e-24q-2p', 'fq_name': ['juniper-qfx5100e-24q-2p'], 'id_perms': {'created': '2025-02-10T00:47:23.572494', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.572494', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13715560682327492406, 'uuid_mslong': 7294464447144280120}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '653b24c4-56c0-4038-be57-75c5bd71c736'}, 'oper': 'CREATE', 'request-id': 'req-489eebf8-cb28-4edb-b860-82f9142b7d12', 'type': 'hardware', 'uuid': '653b24c4-56c0-4038-be57-75c5bd71c736'} 02/10/2025 00:47:23.618 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.670 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-02-10T00:47:23.651336', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.651336', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10786798739356621245, 'uuid_mslong': 9100999334929122209}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-0f5e2809-aef6-41bf-ab29-ee3d76b5edcf', 'type': 'alarm', 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd'} 02/10/2025 00:47:23.681 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'obj_dict': {'display_name': 'juniper-qfx5110-48s-4c', 'fq_name': ['juniper-qfx5110-48s-4c'], 'id_perms': {'created': '2025-02-10T00:47:23.670594', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.670594', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12685752015302664609, 'uuid_mslong': 15830658504563376582}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'dbb1cc09-1504-41c6-b00c-d83ef4cfa1a1'}, 'oper': 'CREATE', 'request-id': 'req-37fcdb1b-a544-4f89-87d1-47da4d86f848', 'type': 'hardware', 'uuid': 'dbb1cc09-1504-41c6-b00c-d83ef4cfa1a1'} 02/10/2025 00:47:23.696 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-32q url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-32q"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.721 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.733 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'obj_dict': {'display_name': 'juniper-qfx5110-32q', 'fq_name': ['juniper-qfx5110-32q'], 'id_perms': {'created': '2025-02-10T00:47:23.703533', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.703533', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12982877294466491250, 'uuid_mslong': 13154822659145813209}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'b68f5182-e1a5-4cd9-b42c-721cf328e372'}, 'oper': 'CREATE', 'request-id': 'req-013e8323-6e92-4137-a58c-5580489ed250', 'type': 'hardware', 'uuid': 'b68f5182-e1a5-4cd9-b42c-721cf328e372'} 02/10/2025 00:47:23.767 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48y-8c', 'fq_name': ['juniper-qfx5120-48y-8c'], 'id_perms': {'created': '2025-02-10T00:47:23.752164', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.752164', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12089305233244889379, 'uuid_mslong': 13847941458867669684}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'c02dc563-2636-4ab4-a7c5-d70ec8d52123'}, 'oper': 'CREATE', 'request-id': 'req-740d8585-9fe6-4034-b895-2b03b4222269', 'type': 'hardware', 'uuid': 'c02dc563-2636-4ab4-a7c5-d70ec8d52123'} 02/10/2025 00:47:23.813 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-02-10T00:47:23.774423', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.774423', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12394286187223663324, 'uuid_mslong': 13534174170697321373}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-c4c48cf0-2193-440c-8ea5-8fccd6347e62', 'type': 'alarm', 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc'} 02/10/2025 00:47:23.859 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'obj_dict': {'display_name': 'juniper-qfx5120-32c', 'fq_name': ['juniper-qfx5120-32c'], 'id_perms': {'created': '2025-02-10T00:47:23.827626', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.827626', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9921700732723151736, 'uuid_mslong': 11198559599263434199}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '9b69469f-7e23-45d7-89b0-f63fbdb24378'}, 'oper': 'CREATE', 'request-id': 'req-b50d1623-362e-48b7-9417-017008b11674', 'type': 'hardware', 'uuid': '9b69469f-7e23-45d7-89b0-f63fbdb24378'} 02/10/2025 00:47:23.871 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.889 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-02-10T00:47:23.879144', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.879144', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12924526882734890375, 'uuid_mslong': 2200597229178736014}}, 'parent_type': 'security-group', 'parent_uuid': '17373a51-0629-4350-aa8a-211358b40cd8', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e8a1785-4ae8-4d8e-b35d-24b907665d87'}, 'oper': 'CREATE', 'request-id': 'req-2407a75c-0432-4868-9f39-83e495e7063b', 'type': 'access_control_list', 'uuid': '1e8a1785-4ae8-4d8e-b35d-24b907665d87'} 02/10/2025 00:47:23.908 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48t-6c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48t-6c"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.909 7fe2411e1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.17:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "egress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "egress-access-control-list"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:23.966 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48t-6c', 'fq_name': ['juniper-qfx5120-48t-6c'], 'id_perms': {'created': '2025-02-10T00:47:23.934677', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.934677', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13350449611324803252, 'uuid_mslong': 16352844450265844662}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'e2f0f962-ed50-4bb6-b946-533012c448b4'}, 'oper': 'CREATE', 'request-id': 'req-7b21cec3-c30d-492d-adf3-045309131cff', 'type': 'hardware', 'uuid': 'e2f0f962-ed50-4bb6-b946-533012c448b4'} 02/10/2025 00:47:23.977 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-02-10T00:47:23.948867', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-02-10T00:47:23.948867', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9622542878435810546, 'uuid_mslong': 8171746544763028994}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-9d815204-34f9-48ac-919b-38e5ecfe63b4', 'type': 'alarm', 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2'} 02/10/2025 00:47:24.006 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-02-10T00:47:23.984029', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:23.984029', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12733078042738015950, 'uuid_mslong': 7390260861372811125}}, 'parent_type': 'security-group', 'parent_uuid': '17373a51-0629-4350-aa8a-211358b40cd8', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '668f7b19-1f99-4775-b0b4-fb0462b9bece'}, 'oper': 'CREATE', 'request-id': 'req-9aa33d57-cc48-4548-8bce-0212c27bd5ef', 'type': 'access_control_list', 'uuid': '668f7b19-1f99-4775-b0b4-fb0462b9bece'} 02/10/2025 00:47:24.018 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'obj_dict': {'display_name': 'juniper-qfx5220-32cd', 'fq_name': ['juniper-qfx5220-32cd'], 'id_perms': {'created': '2025-02-10T00:47:24.006488', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.006488', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9678074659246454077, 'uuid_mslong': 5333452282802948669}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '4a043a97-e6f7-4a3d-864f-6da03e18353d'}, 'oper': 'CREATE', 'request-id': 'req-e00eba42-13bc-47e4-b881-b5977fc8d3c1', 'type': 'hardware', 'uuid': '4a043a97-e6f7-4a3d-864f-6da03e18353d'} 02/10/2025 00:47:24.033 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.082 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'obj_dict': {'display_name': 'juniper-qfx5220-128c', 'fq_name': ['juniper-qfx5220-128c'], 'id_perms': {'created': '2025-02-10T00:47:24.062566', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.062566', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9286487765800058494, 'uuid_mslong': 17110253402077479836}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'ed73d4d0-afbf-439c-80e0-3b6bcb85fe7e'}, 'oper': 'CREATE', 'request-id': 'req-59c61154-ceea-4dcd-af76-7bdc9687603a', 'type': 'hardware', 'uuid': 'ed73d4d0-afbf-439c-80e0-3b6bcb85fe7e'} 02/10/2025 00:47:24.101 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-32c-32q url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-32c-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-32c-32q"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.102 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-02-10T00:47:24.093281', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.093281', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12420122996666628610, 'uuid_mslong': 2510576783457078536}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '22d75c48-6f4d-4d08-ac5d-240f92f97a02'}, 'oper': 'CREATE', 'request-id': 'req-57c7bd27-7595-4d08-bb8e-ee31f5d23dc2', 'type': 'route_target', 'uuid': '22d75c48-6f4d-4d08-ac5d-240f92f97a02'} 02/10/2025 00:47:24.118 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-02-10T00:47:24.093951', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-02-10T00:47:24.093951', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11107305133595922366, 'uuid_mslong': 13552792498983880184}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-c3155eb5-a1e9-44bf-971f-c0c1d9f72add', 'type': 'alarm', 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe'} 02/10/2025 00:47:24.161 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'obj_dict': {'display_name': 'juniper-qfx5200-32c-32q', 'fq_name': ['juniper-qfx5200-32c-32q'], 'id_perms': {'created': '2025-02-10T00:47:24.122329', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.122329', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11963003233001739699, 'uuid_mslong': 12189771134049144720}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'a92ac443-224f-4f90-a605-200ec5eb15b3'}, 'oper': 'CREATE', 'request-id': 'req-67d84afc-908f-431f-bb74-f179a2dcc76b', 'type': 'hardware', 'uuid': 'a92ac443-224f-4f90-a605-200ec5eb15b3'} 02/10/2025 00:47:24.162 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-246b0304-78cc-45f5-8af2-5808605b225a', 'type': 'routing_instance', 'uuid': '8e048815-bd6e-445b-988f-02657b027075'} 02/10/2025 00:47:24.177 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.187 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'obj_dict': {'display_name': 'juniper-qfx5200-48y', 'fq_name': ['juniper-qfx5200-48y'], 'id_perms': {'created': '2025-02-10T00:47:24.174483', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.174483', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13739111939493121335, 'uuid_mslong': 6140923941648943754}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '5538f1c9-f6ad-4a8a-beab-21841ad0cd37'}, 'oper': 'CREATE', 'request-id': 'req-f5c4fcd9-379c-46d8-9e82-0993df6d5c8b', 'type': 'hardware', 'uuid': '5538f1c9-f6ad-4a8a-beab-21841ad0cd37'} 02/10/2025 00:47:24.191 7fe2411e1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000001 url = http://10.0.0.17:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000001"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000001"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.221 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-02-10T00:47:24.210880', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.210880', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10549229303007892524, 'uuid_mslong': 11427494197853309240}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '9e969d6d-6fe2-4938-9266-6428abed542c'}, 'oper': 'CREATE', 'request-id': 'req-55df1903-1398-4c02-b08d-bc599da0b6d9', 'type': 'route_target', 'uuid': '9e969d6d-6fe2-4938-9266-6428abed542c'} 02/10/2025 00:47:24.232 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'obj_dict': {'display_name': 'juniper-qfx5210-64c', 'fq_name': ['juniper-qfx5210-64c'], 'id_perms': {'created': '2025-02-10T00:47:24.214333', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.214333', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11233242848472439923, 'uuid_mslong': 4673294685048030601}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '40dae0c1-8102-4589-9be4-7edabae59c73'}, 'oper': 'CREATE', 'request-id': 'req-b974df5b-f235-4e08-b95a-5d8e84295177', 'type': 'hardware', 'uuid': '40dae0c1-8102-4589-9be4-7edabae59c73'} 02/10/2025 00:47:24.246 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-72q url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-72q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-72q"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.250 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-02-10T00:47:24.239515', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-02-10T00:47:24.239515', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12297068995312071348, 'uuid_mslong': 3076180785682992079}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-59547cda-e620-4ca0-a9a0-88554ebd830e', 'type': 'alarm', 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4'} 02/10/2025 00:47:24.273 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'obj_dict': {'display_name': 'juniper-qfx10002-72q', 'fq_name': ['juniper-qfx10002-72q'], 'id_perms': {'created': '2025-02-10T00:47:24.259064', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.259064', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12666955170422157900, 'uuid_mslong': 13532214968825430688}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'bbcc15d1-4110-42a0-afca-109d76cf724c'}, 'oper': 'CREATE', 'request-id': 'req-2a98422f-cfbe-4bc9-8943-83a161f5ac44', 'type': 'hardware', 'uuid': 'bbcc15d1-4110-42a0-afca-109d76cf724c'} 02/10/2025 00:47:24.279 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-13efd91e-5faf-4309-bda8-2a582c27180f', 'type': 'routing_instance', 'uuid': 'ef9c1bc1-5e42-46ee-a520-d4ea98936273'} 02/10/2025 00:47:24.307 7fe248d21f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.17:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.17 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.317 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'obj_dict': {'display_name': 'juniper-qfx10002-36q', 'fq_name': ['juniper-qfx10002-36q'], 'id_perms': {'created': '2025-02-10T00:47:24.300617', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.300617', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11315661892547941316, 'uuid_mslong': 18356838238497492246}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'fec0971e-84f3-4d16-9d09-4e89cfbe93c4'}, 'oper': 'CREATE', 'request-id': 'req-d78710cc-fd1a-4a57-b28d-f8efddd8110e', 'type': 'hardware', 'uuid': 'fec0971e-84f3-4d16-9d09-4e89cfbe93c4'} 02/10/2025 00:47:24.342 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-02-10T00:47:24.319057', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.319057', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13798536845528386745, 'uuid_mslong': 5323959072121176588}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '49e28091-8c80-420c-bf7e-402739dbccb9'}, 'oper': 'CREATE', 'request-id': 'req-efce00cc-798f-44b2-82db-907c9a0f1e17', 'type': 'route_target', 'uuid': '49e28091-8c80-420c-bf7e-402739dbccb9'} 02/10/2025 00:47:24.356 7fe2411e1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 05a57f6e-2903-4a97-82c3-373483b53d39 object_type = routing_instance identifier_name = default-domain:default-project:default-virtual-network:default-virtual-network url = http://10.0.0.17:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"type": "routing-instance", "uuid": "05a57f6e-2903-4a97-82c3-373483b53d39", "ref-type": "route-target", "ref-uuid": "49e28091-8c80-420c-bf7e-402739dbccb9", "ref-fq-name": ["target:64512:8000002"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.397 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'obj_dict': {'display_name': 'juniper-qfx10002-60c', 'fq_name': ['juniper-qfx10002-60c'], 'id_perms': {'created': '2025-02-10T00:47:24.382830', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.382830', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11193699499563335681, 'uuid_mslong': 7237690388107969540}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '6471710f-a16f-4404-9b58-026359f0c001'}, 'oper': 'CREATE', 'request-id': 'req-c74dc484-ab53-44e5-9915-f2e2e3e03cae', 'type': 'hardware', 'uuid': '6471710f-a16f-4404-9b58-026359f0c001'} 02/10/2025 00:47:24.412 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10016 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10016"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.415 7fe240858588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:24.416 7fe240858588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:24.417 7fe240858588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:24.418 7fe240858588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:24.418 7fe240858588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:24.441 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-02-10T00:47:24.424584', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-02-10T00:47:24.424584', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9994880356001063313, 'uuid_mslong': 11945134769066953529}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-bca9be2f-bdc2-4134-9026-949c8fa25e8b', 'type': 'alarm', 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191'} 02/10/2025 00:47:24.449 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-ce4559b6-3b2f-4d0c-aab5-8f06221b6988', 'type': 'routing_instance', 'uuid': '05a57f6e-2903-4a97-82c3-373483b53d39'} 02/10/2025 00:47:24.456 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10016'], 'obj_dict': {'display_name': 'juniper-qfx10016', 'fq_name': ['juniper-qfx10016'], 'id_perms': {'created': '2025-02-10T00:47:24.423609', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.423609', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11175829410273288745, 'uuid_mslong': 6053424836058761126}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '540215d0-e3cf-47a6-9b18-85a2f5b3e229'}, 'oper': 'CREATE', 'request-id': 'req-ae1fe5b2-9c29-4f02-9218-8eb9359694bd', 'type': 'hardware', 'uuid': '540215d0-e3cf-47a6-9b18-85a2f5b3e229'} 02/10/2025 00:47:24.497 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-02-10T00:47:24.480543', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.480543', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11487542240958335755, 'uuid_mslong': 18125888039126321179}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'fb8c1722-f2a0-481b-9f6b-f2cdf69dcb0b'}, 'oper': 'CREATE', 'request-id': 'req-2b57c06b-19bc-43d2-b339-ed939f60999c', 'type': 'route_target', 'uuid': 'fb8c1722-f2a0-481b-9f6b-f2cdf69dcb0b'} 02/10/2025 00:47:24.501 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10008'], 'obj_dict': {'display_name': 'juniper-qfx10008', 'fq_name': ['juniper-qfx10008'], 'id_perms': {'created': '2025-02-10T00:47:24.487808', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.487808', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11687417679477365775, 'uuid_mslong': 15026880075066329973}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'd08a33cf-fcb9-4b75-a232-0c74f6de5c0f'}, 'oper': 'CREATE', 'request-id': 'req-4f25d1bf-8ae2-4c87-9a90-aec4a45d0be7', 'type': 'hardware', 'uuid': 'd08a33cf-fcb9-4b75-a232-0c74f6de5c0f'} 02/10/2025 00:47:24.543 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'obj_dict': {'display_name': 'juniper-vqfx-10000', 'fq_name': ['juniper-vqfx-10000'], 'id_perms': {'created': '2025-02-10T00:47:24.531879', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.531879', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13627356223855409146, 'uuid_mslong': 4694198164237798290}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '4125245c-04af-4b92-bd1e-1848e69c37fa'}, 'oper': 'CREATE', 'request-id': 'req-a47e5cc2-11a2-412b-9971-cd08d9cc46f6', 'type': 'hardware', 'uuid': '4125245c-04af-4b92-bd1e-1848e69c37fa'} 02/10/2025 00:47:24.557 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.560 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-92b260a3-7130-4e62-8904-f97ddd75cef7', 'type': 'routing_instance', 'uuid': '08b0e674-2c2c-40a8-89d9-e8af64d04f6e'} 02/10/2025 00:47:24.580 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80'], 'obj_dict': {'display_name': 'juniper-mx80', 'fq_name': ['juniper-mx80'], 'id_perms': {'created': '2025-02-10T00:47:24.565433', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.565433', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12419080354241847129, 'uuid_mslong': 1758933719648060177}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '1868fce6-1714-4311-ac59-6fc8779e1f59'}, 'oper': 'CREATE', 'request-id': 'req-4439ded2-defb-4831-8428-d665e49a9151', 'type': 'hardware', 'uuid': '1868fce6-1714-4311-ac59-6fc8779e1f59'} 02/10/2025 00:47:24.714 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'obj_dict': {'display_name': 'juniper-mx80-48t', 'fq_name': ['juniper-mx80-48t'], 'id_perms': {'created': '2025-02-10T00:47:24.682883', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.682883', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11630453703172218071, 'uuid_mslong': 17652706531527836366}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'f4fb030f-f7ef-42ce-a167-ac05b234dcd7'}, 'oper': 'CREATE', 'request-id': 'req-cddeda4b-428f-4ca2-8fb8-c667c40b6f87', 'type': 'hardware', 'uuid': 'f4fb030f-f7ef-42ce-a167-ac05b234dcd7'} 02/10/2025 00:47:24.747 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx204'], 'obj_dict': {'display_name': 'juniper-mx204', 'fq_name': ['juniper-mx204'], 'id_perms': {'created': '2025-02-10T00:47:24.738942', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.738942', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11977495259881973078, 'uuid_mslong': 3468840553106653923}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '3023cc1a-b664-42e3-a638-9c7ab830a556'}, 'oper': 'CREATE', 'request-id': 'req-b29f6b7a-690c-4411-bfc6-62b42f2ef62e', 'type': 'hardware', 'uuid': '3023cc1a-b664-42e3-a638-9c7ab830a556'} 02/10/2025 00:47:24.767 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx240 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx240"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx240"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.776 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-02-10T00:47:24.731545', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.731545', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10307238989724099178, 'uuid_mslong': 10645823269507711620}}, 'parent_type': 'virtual-network', 'parent_uuid': 'f712f046-052f-4c93-8af7-f43ecfc046ae', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '93bd8fdc-1098-4284-8f0a-ab40458fa26a'}, 'oper': 'CREATE', 'request-id': 'req-db6bdb98-c195-49b2-9568-08604ab2dd8d', 'type': 'access_control_list', 'uuid': '93bd8fdc-1098-4284-8f0a-ab40458fa26a'} 02/10/2025 00:47:24.798 7fe2411e1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 668f7b19-1f99-4775-b0b4-fb0462b9bece object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.17:8082/access-control-list/668f7b19-1f99-4775-b0b4-fb0462b9bece operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"access-control-list": {"uuid": "668f7b19-1f99-4775-b0b4-fb0462b9bece", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:24.805 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-e0d65e8c-5065-4443-88c6-4813f4357afa', 'type': 'access_control_list', 'uuid': '1e8a1785-4ae8-4d8e-b35d-24b907665d87'} 02/10/2025 00:47:24.808 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx240'], 'obj_dict': {'display_name': 'juniper-mx240', 'fq_name': ['juniper-mx240'], 'id_perms': {'created': '2025-02-10T00:47:24.792638', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.792638', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9260883900794789531, 'uuid_mslong': 296739684545743643}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '041e3b2b-c01c-4b1b-8085-44d76d01de9b'}, 'oper': 'CREATE', 'request-id': 'req-84ab2e58-533e-4ac8-8068-264df9214a5c', 'type': 'hardware', 'uuid': '041e3b2b-c01c-4b1b-8085-44d76d01de9b'} 02/10/2025 00:47:24.848 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-a29521ef-b4bd-4c32-9eb6-07cdd868b264', 'type': 'access_control_list', 'uuid': '668f7b19-1f99-4775-b0b4-fb0462b9bece'} 02/10/2025 00:47:24.886 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx480'], 'obj_dict': {'display_name': 'juniper-mx480', 'fq_name': ['juniper-mx480'], 'id_perms': {'created': '2025-02-10T00:47:24.874508', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.874508', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12635289284897808458, 'uuid_mslong': 9191458842687917230}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '7f8e9f1e-7609-4cae-af59-90a8f4a2204a'}, 'oper': 'CREATE', 'request-id': 'req-4a8c8e4e-7f25-4c4f-84ef-bb76c394152d', 'type': 'hardware', 'uuid': '7f8e9f1e-7609-4cae-af59-90a8f4a2204a'} 02/10/2025 00:47:24.976 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx960'], 'obj_dict': {'display_name': 'juniper-mx960', 'fq_name': ['juniper-mx960'], 'id_perms': {'created': '2025-02-10T00:47:24.964482', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:24.964482', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9415673907881821234, 'uuid_mslong': 7390097674657091571}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '668ee6ae-4160-4ff3-82ab-31886835c432'}, 'oper': 'CREATE', 'request-id': 'req-96d4ff2f-5e1c-4841-9192-7a28e79f5677', 'type': 'hardware', 'uuid': '668ee6ae-4160-4ff3-82ab-31886835c432'} 02/10/2025 00:47:24.996 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2008 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2008"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.043 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2008'], 'obj_dict': {'display_name': 'juniper-mx2008', 'fq_name': ['juniper-mx2008'], 'id_perms': {'created': '2025-02-10T00:47:25.031904', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.031904', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11324624745348962550, 'uuid_mslong': 5166038979656632093}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '47b17514-c641-471d-9d29-2634991f98f6'}, 'oper': 'CREATE', 'request-id': 'req-4e17fe19-9058-4bf9-a850-4275a6b49e3c', 'type': 'hardware', 'uuid': '47b17514-c641-471d-9d29-2634991f98f6'} 02/10/2025 00:47:25.081 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2010'], 'obj_dict': {'display_name': 'juniper-mx2010', 'fq_name': ['juniper-mx2010'], 'id_perms': {'created': '2025-02-10T00:47:25.062056', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.062056', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12297825411095866168, 'uuid_mslong': 3099573304707729171}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '2b03e57f-9663-4713-aaaa-a70e02242b38'}, 'oper': 'CREATE', 'request-id': 'req-7f7e7b55-60b6-4203-8341-bae1f487b3c0', 'type': 'hardware', 'uuid': '2b03e57f-9663-4713-aaaa-a70e02242b38'} 02/10/2025 00:47:25.119 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2020'], 'obj_dict': {'display_name': 'juniper-mx2020', 'fq_name': ['juniper-mx2020'], 'id_perms': {'created': '2025-02-10T00:47:25.108785', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.108785', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13235728081601935529, 'uuid_mslong': 3252599137291881219}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '2d238dae-af06-4b03-b7ae-c090778bb8a9'}, 'oper': 'CREATE', 'request-id': 'req-7de27ed9-ee93-459f-927d-168427e89379', 'type': 'hardware', 'uuid': '2d238dae-af06-4b03-b7ae-c090778bb8a9'} 02/10/2025 00:47:25.138 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx10003 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx10003"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx10003"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.190 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx10003'], 'obj_dict': {'display_name': 'juniper-mx10003', 'fq_name': ['juniper-mx10003'], 'id_perms': {'created': '2025-02-10T00:47:25.152489', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.152489', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12013492532511676970, 'uuid_mslong': 14067258660826661284}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'c338f138-721c-41a4-a6b8-7fcee02a9a2a'}, 'oper': 'CREATE', 'request-id': 'req-e5b3566d-3341-4a0f-8554-2f15bf6d138b', 'type': 'hardware', 'uuid': 'c338f138-721c-41a4-a6b8-7fcee02a9a2a'} 02/10/2025 00:47:25.313 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10008'], 'obj_dict': {'display_name': 'juniper-jnp10008', 'fq_name': ['juniper-jnp10008'], 'id_perms': {'created': '2025-02-10T00:47:25.294061', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.294061', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11117817059977113307, 'uuid_mslong': 9053760489715616698}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '7da56b32-4ef7-4bba-9a4a-6bb619b6aedb'}, 'oper': 'CREATE', 'request-id': 'req-c24b773b-56c9-4030-a25c-b629464c1b8c', 'type': 'hardware', 'uuid': '7da56b32-4ef7-4bba-9a4a-6bb619b6aedb'} 02/10/2025 00:47:25.360 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10016'], 'obj_dict': {'display_name': 'juniper-jnp10016', 'fq_name': ['juniper-jnp10016'], 'id_perms': {'created': '2025-02-10T00:47:25.331427', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.331427', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10919087119192354358, 'uuid_mslong': 17777346509954958633}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'f6b5d276-5ee5-4529-9788-63e21300ee36'}, 'oper': 'CREATE', 'request-id': 'req-98e0205f-2918-49a6-a5f2-e872d15e9044', 'type': 'hardware', 'uuid': 'f6b5d276-5ee5-4529-9788-63e21300ee36'} 02/10/2025 00:47:25.369 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vmx url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vmx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vmx"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.409 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vmx'], 'obj_dict': {'display_name': 'juniper-vmx', 'fq_name': ['juniper-vmx'], 'id_perms': {'created': '2025-02-10T00:47:25.388405', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.388405', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12261228876307867825, 'uuid_mslong': 11489913051708017072}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '9f745f0b-5b2e-49b0-aa28-a2b34217a8b1'}, 'oper': 'CREATE', 'request-id': 'req-e7e44947-e0aa-4616-ac4b-52c91021b557', 'type': 'hardware', 'uuid': '9f745f0b-5b2e-49b0-aa28-a2b34217a8b1'} 02/10/2025 00:47:25.469 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5400'], 'obj_dict': {'display_name': 'juniper-srx5400', 'fq_name': ['juniper-srx5400'], 'id_perms': {'created': '2025-02-10T00:47:25.462214', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.462214', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9496824668100388006, 'uuid_mslong': 6988076528984015979}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '60faa294-2556-446b-83cb-7fb8244a64a6'}, 'oper': 'CREATE', 'request-id': 'req-e7d124dd-72cf-474c-b117-969838d8f4d3', 'type': 'hardware', 'uuid': '60faa294-2556-446b-83cb-7fb8244a64a6'} 02/10/2025 00:47:25.509 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5600'], 'obj_dict': {'display_name': 'juniper-srx5600', 'fq_name': ['juniper-srx5600'], 'id_perms': {'created': '2025-02-10T00:47:25.496832', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.496832', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10226762000474876712, 'uuid_mslong': 6477804713252700833}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '59e5c910-d9c7-42a1-8dec-c1db10c4ab28'}, 'oper': 'CREATE', 'request-id': 'req-8f2ad23d-ae83-4152-855a-04de80c9e29b', 'type': 'hardware', 'uuid': '59e5c910-d9c7-42a1-8dec-c1db10c4ab28'} 02/10/2025 00:47:25.537 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4600 url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4600"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.583 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4600'], 'obj_dict': {'display_name': 'juniper-srx4600', 'fq_name': ['juniper-srx4600'], 'id_perms': {'created': '2025-02-10T00:47:25.572757', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.572757', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13566084524097768383, 'uuid_mslong': 17305032288406947291}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'f027d32e-2929-45db-bc44-69ff9bc58bbf'}, 'oper': 'CREATE', 'request-id': 'req-c5548f0f-2197-441d-a45d-8ccd8ffba4a0', 'type': 'hardware', 'uuid': 'f027d32e-2929-45db-bc44-69ff9bc58bbf'} 02/10/2025 00:47:25.622 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4100'], 'obj_dict': {'display_name': 'juniper-srx4100', 'fq_name': ['juniper-srx4100'], 'id_perms': {'created': '2025-02-10T00:47:25.605772', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.605772', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13014939593511115164, 'uuid_mslong': 11658764483935553667}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'a1cc4087-00eb-4883-b49e-5a9aac65999c'}, 'oper': 'CREATE', 'request-id': 'req-a9fbc3b8-fd0b-49ad-a055-39f4ff6bdefd', 'type': 'hardware', 'uuid': 'a1cc4087-00eb-4883-b49e-5a9aac65999c'} 02/10/2025 00:47:25.692 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx1500'], 'obj_dict': {'display_name': 'juniper-srx1500', 'fq_name': ['juniper-srx1500'], 'id_perms': {'created': '2025-02-10T00:47:25.677038', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.677038', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10380191061625886786, 'uuid_mslong': 14467879043120513178}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': 'c8c83b55-ea84-409a-900d-d8c620e55842'}, 'oper': 'CREATE', 'request-id': 'req-4bf05417-a3b4-4dae-8305-0c32e8cc396e', 'type': 'hardware', 'uuid': 'c8c83b55-ea84-409a-900d-d8c620e55842'} 02/10/2025 00:47:25.700 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx240h-poe url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx240h-poe"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx240h-poe"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.737 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'obj_dict': {'display_name': 'juniper-srx240h-poe', 'fq_name': ['juniper-srx240h-poe'], 'id_perms': {'created': '2025-02-10T00:47:25.715156', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.715156', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12808008814994953579, 'uuid_mslong': 11463420531146573341}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '9f16403c-bde9-461d-b1bf-302851d8956b'}, 'oper': 'CREATE', 'request-id': 'req-811be59d-d6ad-4d48-90c1-76e20522a17e', 'type': 'hardware', 'uuid': '9f16403c-bde9-461d-b1bf-302851d8956b'} 02/10/2025 00:47:25.788 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5800'], 'obj_dict': {'display_name': 'juniper-srx5800', 'fq_name': ['juniper-srx5800'], 'id_perms': {'created': '2025-02-10T00:47:25.777171', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.777171', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12766805555659670778, 'uuid_mslong': 417534986979722958}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '05cb61db-c439-46ce-b12c-ce02ed9404fa'}, 'oper': 'CREATE', 'request-id': 'req-3dae73a2-6e9d-4e26-8f6d-0035f8ff4220', 'type': 'hardware', 'uuid': '05cb61db-c439-46ce-b12c-ce02ed9404fa'} 02/10/2025 00:47:25.821 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4200'], 'obj_dict': {'display_name': 'juniper-srx4200', 'fq_name': ['juniper-srx4200'], 'id_perms': {'created': '2025-02-10T00:47:25.805283', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.805283', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9358700357135892228, 'uuid_mslong': 1095053376645122324}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '0f32693e-8506-4914-81e0-c863ea67ff04'}, 'oper': 'CREATE', 'request-id': 'req-6e745cf5-1d02-43ab-8863-a830d568bd7d', 'type': 'hardware', 'uuid': '0f32693e-8506-4914-81e0-c863ea67ff04'} 02/10/2025 00:47:25.872 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vsrx url = http://10.0.0.17:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vsrx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "b81cc19dda964068a46142918d560c5c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vsrx"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.892 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vsrx'], 'obj_dict': {'display_name': 'juniper-vsrx', 'fq_name': ['juniper-vsrx'], 'id_perms': {'created': '2025-02-10T00:47:25.886240', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.886240', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12061467783320481287, 'uuid_mslong': 7483052330455221643}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '67d92472-9871-458b-a762-f10b66a2ae07'}, 'oper': 'CREATE', 'request-id': 'req-8ac67c7c-a995-45cf-b933-f75ff1cacd50', 'type': 'hardware', 'uuid': '67d92472-9871-458b-a762-f10b66a2ae07'} 02/10/2025 00:47:25.956 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'obj_dict': {'display_name': 'underlay-ip-clos', 'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'id_perms': {'created': '2025-02-10T00:47:25.947143', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:25.947143', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10794312438063822495, 'uuid_mslong': 9359008524254463316}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '81e1e0aa-aa0a-4554-95cd-19f8c15ff69f'}, 'oper': 'CREATE', 'request-id': 'req-8ca39973-f219-49fa-94c9-45cbb7d4e05b', 'type': 'feature', 'uuid': '81e1e0aa-aa0a-4554-95cd-19f8c15ff69f'} 02/10/2025 00:47:25.983 7fe2408a8978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.17 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:25.998 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-23c46cfe-4857-45bb-a0be-7c04e1b4d16f', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:26.023 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'obj_dict': {'display_name': 'overlay-bgp', 'fq_name': ['default-global-system-config', 'overlay-bgp'], 'id_perms': {'created': '2025-02-10T00:47:26.010362', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.010362', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13707473356384000135, 'uuid_mslong': 5839969532731211981}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '510bbd59-398c-40cd-be3a-ba646f665887'}, 'oper': 'CREATE', 'request-id': 'req-ffc70453-e963-4239-b33a-be76d7d0ab7a', 'type': 'feature', 'uuid': '510bbd59-398c-40cd-be3a-ba646f665887'} 02/10/2025 00:47:26.070 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l2-gateway url = http://10.0.0.17:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l2-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l2-gateway"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:26.145 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'obj_dict': {'display_name': 'l2-gateway', 'fq_name': ['default-global-system-config', 'l2-gateway'], 'id_perms': {'created': '2025-02-10T00:47:26.124490', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.124490', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10022764650511269085, 'uuid_mslong': 11856873435537756135}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a48c1391-b7fe-4fe7-8b18-0358c510fcdd'}, 'oper': 'CREATE', 'request-id': 'req-9df2eff3-8f53-468b-b41c-ddf347f08886', 'type': 'feature', 'uuid': 'a48c1391-b7fe-4fe7-8b18-0358c510fcdd'} 02/10/2025 00:47:26.241 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'fq_name': ['default-global-system-config', 'l3-gateway'], 'id_perms': {'created': '2025-02-10T00:47:26.231260', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.231260', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9452169764867225634, 'uuid_mslong': 10135976717419365632}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8caa391f-2d69-4500-832c-da5247993822'}, 'oper': 'CREATE', 'request-id': 'req-ca0f131f-6e82-4702-9ca1-e98f5158d4a3', 'type': 'feature', 'uuid': '8caa391f-2d69-4500-832c-da5247993822'} 02/10/2025 00:47:26.311 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'obj_dict': {'display_name': 'vn-interconnect', 'fq_name': ['default-global-system-config', 'vn-interconnect'], 'id_perms': {'created': '2025-02-10T00:47:26.301881', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.301881', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9773752772580124754, 'uuid_mslong': 2414386163048464739}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '21819f6c-5f1f-4163-87a3-585cf420a852'}, 'oper': 'CREATE', 'request-id': 'req-ac394802-9e9a-4d51-8ab1-cdb4eb5d0674', 'type': 'feature', 'uuid': '21819f6c-5f1f-4163-87a3-585cf420a852'} 02/10/2025 00:47:26.351 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:dc-gateway url = http://10.0.0.17:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:26.423 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-02-10T00:47:26.385380', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.385380', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9376744072668468289, 'uuid_mslong': 3828186350845051761}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '35207334-181e-4371-8220-e30dd1275441'}, 'oper': 'CREATE', 'request-id': 'req-8350a411-71a0-404b-a48b-5243c12e9324', 'type': 'feature', 'uuid': '35207334-181e-4371-8220-e30dd1275441'} 02/10/2025 00:47:26.513 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'fq_name': ['default-global-system-config', 'assisted-replicator'], 'id_perms': {'created': '2025-02-10T00:47:26.493399', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.493399', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12467793994615297851, 'uuid_mslong': 2654974974065395510}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '24d85dac-18b8-4736-ad06-8094b5cb173b'}, 'oper': 'CREATE', 'request-id': 'req-08a18a6e-4e27-4ca6-bd0f-4f2444e12882', 'type': 'feature', 'uuid': '24d85dac-18b8-4736-ad06-8094b5cb173b'} 02/10/2025 00:47:26.591 7fe2411e4d68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.17"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:26.593 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'obj_dict': {'display_name': 'port-profile', 'fq_name': ['default-global-system-config', 'port-profile'], 'id_perms': {'created': '2025-02-10T00:47:26.587063', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.587063', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10165824026260487924, 'uuid_mslong': 17745503618212972991}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f644b185-63fe-49bf-8d14-43174e633ef4'}, 'oper': 'CREATE', 'request-id': 'req-9a39df97-5ab4-4e64-b3cc-009d0438b8aa', 'type': 'feature', 'uuid': 'f644b185-63fe-49bf-8d14-43174e633ef4'} 02/10/2025 00:47:26.609 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-0e7cf1d8-a20f-4850-9457-2c7b9d06b200', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:26.612 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:telemetry url = http://10.0.0.17:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "telemetry"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "telemetry"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:26.644 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'obj_dict': {'display_name': 'telemetry', 'fq_name': ['default-global-system-config', 'telemetry'], 'id_perms': {'created': '2025-02-10T00:47:26.630484', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.630484', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11241184354541580511, 'uuid_mslong': 2351001427999278188}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '20a06f57-b655-446c-9c00-b59cb32130df'}, 'oper': 'CREATE', 'request-id': 'req-9b3a8a51-1883-4a4e-82a8-330b47079aa9', 'type': 'feature', 'uuid': '20a06f57-b655-446c-9c00-b59cb32130df'} 02/10/2025 00:47:26.749 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'obj_dict': {'display_name': 'firewall', 'fq_name': ['default-global-system-config', 'firewall'], 'id_perms': {'created': '2025-02-10T00:47:26.726380', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.726380', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10161831534932873718, 'uuid_mslong': 17435624667739736480}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f1f7c841-e5aa-49a0-8d06-13f0fb0951f6'}, 'oper': 'CREATE', 'request-id': 'req-de5675ad-670b-4fb2-ba61-74692f30ba9d', 'type': 'feature', 'uuid': 'f1f7c841-e5aa-49a0-8d06-13f0fb0951f6'} 02/10/2025 00:47:26.850 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'obj_dict': {'display_name': 'infra-bms-access', 'fq_name': ['default-global-system-config', 'infra-bms-access'], 'id_perms': {'created': '2025-02-10T00:47:26.844192', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.844192', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13413494223957806592, 'uuid_mslong': 17504851350798027286}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f2edb98f-1255-4a16-ba26-4dedcfc24e00'}, 'oper': 'CREATE', 'request-id': 'req-a5f26547-fad2-49d0-85dd-2e62c94e3ef1', 'type': 'feature', 'uuid': 'f2edb98f-1255-4a16-ba26-4dedcfc24e00'} 02/10/2025 00:47:26.873 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:pnf-service-chaining url = http://10.0.0.17:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-service-chaining"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-service-chaining"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:26.913 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'obj_dict': {'display_name': 'pnf-service-chaining', 'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'id_perms': {'created': '2025-02-10T00:47:26.901706', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.901706', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12288457657721107919, 'uuid_mslong': 12341312101050304512}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ab4525f8-0555-4800-aa89-5f21f5e535cf'}, 'oper': 'CREATE', 'request-id': 'req-71074ad0-18c6-4004-a3cc-cc6d34440552', 'type': 'feature', 'uuid': 'ab4525f8-0555-4800-aa89-5f21f5e535cf'} 02/10/2025 00:47:26.992 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'obj_dict': {'display_name': 'leaf', 'fq_name': ['default-global-system-config', 'leaf'], 'id_perms': {'created': '2025-02-10T00:47:26.986478', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:26.986478', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11234630019000804753, 'uuid_mslong': 18357203698829444297}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fec1e380-e237-44c9-9be9-6c7a897ba591'}, 'oper': 'CREATE', 'request-id': 'req-10233747-014a-4b10-a46d-f66284a670f9', 'type': 'physical_role', 'uuid': 'fec1e380-e237-44c9-9be9-6c7a897ba591'} 02/10/2025 00:47:27.050 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'obj_dict': {'display_name': 'spine', 'fq_name': ['default-global-system-config', 'spine'], 'id_perms': {'created': '2025-02-10T00:47:27.038415', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.038415', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12641033997654919637, 'uuid_mslong': 13835460145778411258}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c0016db2-fd32-46fa-af6d-f9721fdb89d5'}, 'oper': 'CREATE', 'request-id': 'req-17ae0653-1506-46d4-9ba6-dd681cd86fc7', 'type': 'physical_role', 'uuid': 'c0016db2-fd32-46fa-af6d-f9721fdb89d5'} 02/10/2025 00:47:27.072 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:superspine url = http://10.0.0.17:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "superspine"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.168 7fe2411e14e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.17"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.172 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'obj_dict': {'display_name': 'superspine', 'fq_name': ['default-global-system-config', 'superspine'], 'id_perms': {'created': '2025-02-10T00:47:27.119983', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.119983', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9264034781588819394, 'uuid_mslong': 18235179897775475149}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fd105f80-be40-49cd-8090-768d07770dc2'}, 'oper': 'CREATE', 'request-id': 'req-de6b0d97-e1da-41ae-a335-1d1386d727a4', 'type': 'physical_role', 'uuid': 'fd105f80-be40-49cd-8090-768d07770dc2'} 02/10/2025 00:47:27.208 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-0bed7c64-0c59-4fb1-a8b7-1fb8d0334c37', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:27.267 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'obj_dict': {'display_name': 'pnf', 'fq_name': ['default-global-system-config', 'pnf'], 'id_perms': {'created': '2025-02-10T00:47:27.244695', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.244695', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9543697661968956734, 'uuid_mslong': 14339873141949353535}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c70176a5-8e0e-4e3f-8472-06757962bd3e'}, 'oper': 'CREATE', 'request-id': 'req-03680cd6-7b00-4826-8b43-709bc0cac480', 'type': 'physical_role', 'uuid': 'c70176a5-8e0e-4e3f-8472-06757962bd3e'} 02/10/2025 00:47:27.381 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'obj_dict': {'display_name': 'erb-ucast-gateway', 'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'id_perms': {'created': '2025-02-10T00:47:27.348723', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.348723', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9789619919670880276, 'uuid_mslong': 11637037895419511518}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a17f104f-6a3d-42de-87db-b77306122814'}, 'oper': 'CREATE', 'request-id': 'req-e66a3754-563d-4a4d-969f-709c0c9b0d57', 'type': 'overlay_role', 'uuid': 'a17f104f-6a3d-42de-87db-b77306122814'} 02/10/2025 00:47:27.428 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-access url = http://10.0.0.17:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.492 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'obj_dict': {'display_name': 'crb-access', 'fq_name': ['default-global-system-config', 'crb-access'], 'id_perms': {'created': '2025-02-10T00:47:27.472635', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.472635', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11125124822443150084, 'uuid_mslong': 15489054541818839888}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd6f42d0a-8fc3-4350-9a64-6215239acb04'}, 'oper': 'CREATE', 'request-id': 'req-e235375c-2a13-4dcf-9202-05d15d775f30', 'type': 'overlay_role', 'uuid': 'd6f42d0a-8fc3-4350-9a64-6215239acb04'} 02/10/2025 00:47:27.576 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'obj_dict': {'display_name': 'crb-mcast-gateway', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'id_perms': {'created': '2025-02-10T00:47:27.559701', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.559701', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9329305645917196251, 'uuid_mslong': 2195336162006026491}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e77669b-a2f0-48fb-8178-5a0e61f0cfdb'}, 'oper': 'CREATE', 'request-id': 'req-5f926ede-4572-4acf-a1ca-c2c8329456e5', 'type': 'overlay_role', 'uuid': '1e77669b-a2f0-48fb-8178-5a0e61f0cfdb'} 02/10/2025 00:47:27.634 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'obj_dict': {'display_name': 'crb-gateway', 'fq_name': ['default-global-system-config', 'crb-gateway'], 'id_perms': {'created': '2025-02-10T00:47:27.628831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.628831', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9948675826821158630, 'uuid_mslong': 8532073455818001716}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7668039a-6b92-4d34-8a10-cbf44330d6e6'}, 'oper': 'CREATE', 'request-id': 'req-303e81d2-645c-4e64-9884-0ea45c670ab8', 'type': 'overlay_role', 'uuid': '7668039a-6b92-4d34-8a10-cbf44330d6e6'} 02/10/2025 00:47:27.649 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.17:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.690 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-02-10T00:47:27.677443', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.677443', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13336055518146568442, 'uuid_mslong': 10987132022358755761}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '987a225c-ad03-49b1-b913-2fd61803a0fa'}, 'oper': 'CREATE', 'request-id': 'req-f192951c-302b-4b8f-b434-e5a61a8f84d2', 'type': 'overlay_role', 'uuid': '987a225c-ad03-49b1-b913-2fd61803a0fa'} 02/10/2025 00:47:27.746 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-996975a4-c532-4f42-b8c2-308cb2c5f156', 'type': 'overlay_role', 'uuid': '1e77669b-a2f0-48fb-8178-5a0e61f0cfdb'} 02/10/2025 00:47:27.835 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-02-10T00:47:27.809472', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.809472', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13755895994357668229, 'uuid_mslong': 10578289361016539090}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '92cda220-aeaf-47d2-bee6-c28666e85985'}, 'oper': 'CREATE', 'request-id': 'req-e2ab65cf-9729-4ece-9468-3aefc31f3b9d', 'type': 'overlay_role', 'uuid': '92cda220-aeaf-47d2-bee6-c28666e85985'} 02/10/2025 00:47:27.880 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = http://10.0.0.17:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.916 7fe2408696d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.17 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:27.948 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'obj_dict': {'display_name': 'dci-gateway', 'fq_name': ['default-global-system-config', 'dci-gateway'], 'id_perms': {'created': '2025-02-10T00:47:27.917614', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:27.917614', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13269278951535303963, 'uuid_mslong': 16341650043688992926}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e2c93422-09d4-409e-b825-f2e71bd45d1b'}, 'oper': 'CREATE', 'request-id': 'req-0e3f86ee-0521-4f77-8e38-7f7b900d2ee0', 'type': 'overlay_role', 'uuid': 'e2c93422-09d4-409e-b825-f2e71bd45d1b'} 02/10/2025 00:47:27.959 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-501a5ea4-6485-4db6-9a1b-7b864ff065d2', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:28.032 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'obj_dict': {'display_name': 'ar-client', 'fq_name': ['default-global-system-config', 'ar-client'], 'id_perms': {'created': '2025-02-10T00:47:28.022018', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.022018', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10563950533824880936, 'uuid_mslong': 17641064333686751286}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f4d1a68b-8d36-4036-929a-b10a516e2128'}, 'oper': 'CREATE', 'request-id': 'req-f4c38ed5-4284-4b1f-8af2-ae12edb75313', 'type': 'overlay_role', 'uuid': 'f4d1a68b-8d36-4036-929a-b10a516e2128'} 02/10/2025 00:47:28.136 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'obj_dict': {'display_name': 'ar-replicator', 'fq_name': ['default-global-system-config', 'ar-replicator'], 'id_perms': {'created': '2025-02-10T00:47:28.122151', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.122151', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9392551952699979446, 'uuid_mslong': 6836779651380890855}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5ee11ede-c02d-4ce7-8259-0c3cb31576b6'}, 'oper': 'CREATE', 'request-id': 'req-a2a09534-bd66-4d49-b267-b96d3dfdd5ba', 'type': 'overlay_role', 'uuid': '5ee11ede-c02d-4ce7-8259-0c3cb31576b6'} 02/10/2025 00:47:28.166 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = http://10.0.0.17:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "route-reflector"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.259 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2a939987-174a-4630-a8da-73397c24674f object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.17:8082/alarm/2a939987-174a-4630-a8da-73397c24674f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "2a939987-174a-4630-a8da-73397c24674f", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.280 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'obj_dict': {'display_name': 'route-reflector', 'fq_name': ['default-global-system-config', 'route-reflector'], 'id_perms': {'created': '2025-02-10T00:47:28.258385', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.258385', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10980256730687667152, 'uuid_mslong': 6689081085509651055}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5cd463ce-9796-4a6f-9861-b552173afbd0'}, 'oper': 'CREATE', 'request-id': 'req-520f4587-9e1f-42da-a328-36a97b05b0e2', 'type': 'overlay_role', 'uuid': '5cd463ce-9796-4a6f-9861-b552173afbd0'} 02/10/2025 00:47:28.300 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2a939987-174a-4630-a8da-73397c24674f object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.17:8082/alarm/2a939987-174a-4630-a8da-73397c24674f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2a939987-174a-4630-a8da-73397c24674f", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.307 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-d518a2dd-5cc0-4379-a0a0-0686f0f56bad', 'type': 'alarm', 'uuid': '2a939987-174a-4630-a8da-73397c24674f'} 02/10/2025 00:47:28.324 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-c142dedc-e8fa-4e1d-972b-4fe6537040d5', 'type': 'alarm', 'uuid': '2a939987-174a-4630-a8da-73397c24674f'} 02/10/2025 00:47:28.340 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'obj_dict': {'display_name': 'lean', 'fq_name': ['default-global-system-config', 'lean'], 'id_perms': {'created': '2025-02-10T00:47:28.327679', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.327679', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12298013818169585895, 'uuid_mslong': 2191273739046898462}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e68f7db-1588-4b1e-aaab-5268f2d7f0e7'}, 'oper': 'CREATE', 'request-id': 'req-c6871487-6db9-4919-9204-e1b082edd064', 'type': 'overlay_role', 'uuid': '1e68f7db-1588-4b1e-aaab-5268f2d7f0e7'} 02/10/2025 00:47:28.412 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'obj_dict': {'display_name': 'pnf-servicechain', 'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'id_perms': {'created': '2025-02-10T00:47:28.399993', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.399993', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10727437707807607774, 'uuid_mslong': 7640024224057675559}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a06d18d-9e56-4f27-94df-83c24400cbde'}, 'oper': 'CREATE', 'request-id': 'req-4c67fb01-f815-439e-83c9-e6627a7483ae', 'type': 'overlay_role', 'uuid': '6a06d18d-9e56-4f27-94df-83c24400cbde'} 02/10/2025 00:47:28.417 7fe2409c3588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:28.418 7fe2409c3588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:28.418 7fe2409c3588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:28.419 7fe2409c3588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:28.420 7fe2409c3588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:28.420 7fe2409c3588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:28.428 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.464 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98901035-1a90-4367-b454-9d41526685d5 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.17:8082/alarm/98901035-1a90-4367-b454-9d41526685d5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "98901035-1a90-4367-b454-9d41526685d5", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.479 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98901035-1a90-4367-b454-9d41526685d5 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.17:8082/alarm/98901035-1a90-4367-b454-9d41526685d5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "98901035-1a90-4367-b454-9d41526685d5", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.504 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'obj_dict': {'display_name': 'erb-leaf', 'fq_name': ['default-global-system-config', 'erb-leaf'], 'id_perms': {'created': '2025-02-10T00:47:28.480631', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.480631', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12371648078955598659, 'uuid_mslong': 13662885850835009945}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'}, 'oper': 'CREATE', 'request-id': 'req-597729f9-e0af-41a1-80e7-72b47cacd359', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:28.511 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-8a26c34d-1b4a-4941-8527-aabd5463270a', 'type': 'alarm', 'uuid': '98901035-1a90-4367-b454-9d41526685d5'} 02/10/2025 00:47:28.522 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-0a74656a-f33e-41a4-9a33-704ed28cf8e4', 'type': 'alarm', 'uuid': '98901035-1a90-4367-b454-9d41526685d5'} 02/10/2025 00:47:28.641 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'obj_dict': {'display_name': 'crb-access-leaf', 'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'id_perms': {'created': '2025-02-10T00:47:28.624170', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.624170', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13740390850340881750, 'uuid_mslong': 1165786155704863313}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'}, 'oper': 'CREATE', 'request-id': 'req-43806f17-b809-4b73-a201-7dae207968bb', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:28.653 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0aee762e-947e-4b77-b51d-06a638ff1416 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.17:8082/alarm/0aee762e-947e-4b77-b51d-06a638ff1416 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "0aee762e-947e-4b77-b51d-06a638ff1416", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.686 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0aee762e-947e-4b77-b51d-06a638ff1416 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.17:8082/alarm/0aee762e-947e-4b77-b51d-06a638ff1416 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "0aee762e-947e-4b77-b51d-06a638ff1416", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.717 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'obj_dict': {'display_name': 'crb-access-spine', 'fq_name': ['default-global-system-config', 'crb-access-spine'], 'id_perms': {'created': '2025-02-10T00:47:28.701721', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.701721', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10685557855712115225, 'uuid_mslong': 8940958465698645757}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'}, 'oper': 'CREATE', 'request-id': 'req-49014988-1156-449b-873f-96826d98750e', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:28.722 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-2dfe12c8-6fb2-4ba6-a55d-0b2135483f07', 'type': 'alarm', 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416'} 02/10/2025 00:47:28.730 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-d41f3ea3-818f-4581-83c7-f15966ff6e47', 'type': 'alarm', 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416'} 02/10/2025 00:47:28.744 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-spine"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.803 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'obj_dict': {'display_name': 'crb-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'id_perms': {'created': '2025-02-10T00:47:28.785145', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.785145', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11168382071275296411, 'uuid_mslong': 8525618169470536903}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'}, 'oper': 'CREATE', 'request-id': 'req-f1886ec2-1012-4ac1-8ac9-876bce110b06', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:28.866 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0178b28a-a433-43ba-9da4-a64837443cd2 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.17:8082/alarm/0178b28a-a433-43ba-9da4-a64837443cd2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "0178b28a-a433-43ba-9da4-a64837443cd2", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.871 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'obj_dict': {'display_name': 'crb-mcast-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'id_perms': {'created': '2025-02-10T00:47:28.863522', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.863522', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10460699722633182994, 'uuid_mslong': 15139071357360229741}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'}, 'oper': 'CREATE', 'request-id': 'req-4fc0b0a8-6baf-46f5-a4aa-79c969642008', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:28.884 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0178b28a-a433-43ba-9da4-a64837443cd2 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.17:8082/alarm/0178b28a-a433-43ba-9da4-a64837443cd2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "0178b28a-a433-43ba-9da4-a64837443cd2", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:28.914 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-7a9c068d-8486-4843-b3e6-69a1b29fb2c1', 'type': 'alarm', 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2'} 02/10/2025 00:47:28.920 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-7110f393-da43-4de4-8786-ed40b005f315', 'type': 'alarm', 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2'} 02/10/2025 00:47:28.929 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-02-10T00:47:28.918085', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:28.918085', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11161956284488787549, 'uuid_mslong': 10771536020085558547}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'}, 'oper': 'CREATE', 'request-id': 'req-bec6a712-7e44-44fd-9ff4-f1d9dfc12a55', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:28.958 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-spine"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.015 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'obj_dict': {'display_name': 'dc-gateway-spine', 'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.000760', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.000760', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12223924952336247804, 'uuid_mslong': 6595993088689128313}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'}, 'oper': 'CREATE', 'request-id': 'req-dd46456d-fb4a-482d-afbb-6f471876001a', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:29.061 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.17:8082/alarm/19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.063 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'obj_dict': {'display_name': 'dci-gateway-spine', 'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.054627', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.054627', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11735544370913563167, 'uuid_mslong': 1348337881051778109}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'}, 'oper': 'CREATE', 'request-id': 'req-e6a73e7a-0263-4488-beae-c9bbe098c9ea', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:29.090 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.17:8082/alarm/19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.091 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-0968e36b-9e35-4f47-9a40-6da7eb588787', 'type': 'alarm', 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1'} 02/10/2025 00:47:29.098 7fe2409a0b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.17 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.103 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'obj_dict': {'display_name': 'crb-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.095065', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.095065', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12966530597786469590, 'uuid_mslong': 16425564676186720595}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'}, 'oper': 'CREATE', 'request-id': 'req-7d6d683c-2341-4391-869e-62b0c2f14ed4', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:29.122 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.127 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-4c6c5cf5-3720-47d0-a1d3-598810787c70', 'type': 'alarm', 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1'} 02/10/2025 00:47:29.140 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-94129d08-c7e6-41f5-b49e-0e396ba5eee1', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:47:29.168 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'obj_dict': {'display_name': 'crb-mcast-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.152135', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.152135', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11453183630935236120, 'uuid_mslong': 7935871492389290296}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'}, 'oper': 'CREATE', 'request-id': 'req-1e1ee778-022a-4edf-916d-648831971a5e', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:29.204 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'obj_dict': {'display_name': 'dc-gateway-leaf', 'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.197964', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.197964', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13071187694712238414, 'uuid_mslong': 8355830844742978587}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'}, 'oper': 'CREATE', 'request-id': 'req-7e425e2c-4519-4e27-930b-c8356a92cc3b', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:29.238 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc9711dd-e3ff-47f9-a2e4-1caf32206d9e object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.17:8082/alarm/cc9711dd-e3ff-47f9-a2e4-1caf32206d9e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "cc9711dd-e3ff-47f9-a2e4-1caf32206d9e", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.262 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'obj_dict': {'display_name': 'dci-gateway-leaf', 'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.243807', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.243807', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12163871834985596234, 'uuid_mslong': 6269173393013361430}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'}, 'oper': 'CREATE', 'request-id': 'req-3b237124-0543-4f7b-a41b-0853c8adbbe7', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:29.282 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc9711dd-e3ff-47f9-a2e4-1caf32206d9e object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.17:8082/alarm/cc9711dd-e3ff-47f9-a2e4-1caf32206d9e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "cc9711dd-e3ff-47f9-a2e4-1caf32206d9e", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.287 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-c1ddfe71-b612-4006-9e55-6429fe141ee1', 'type': 'alarm', 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e'} 02/10/2025 00:47:29.289 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.313 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-480da00f-361d-4679-897c-60522cc057b1', 'type': 'alarm', 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e'} 02/10/2025 00:47:29.329 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'obj_dict': {'display_name': 'ar-client-leaf', 'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.311512', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.311512', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13814360762657101340, 'uuid_mslong': 7642270223623472658}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'}, 'oper': 'CREATE', 'request-id': 'req-34f08230-f145-4048-a504-b3662e3ef790', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:29.378 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'obj_dict': {'display_name': 'ar-client-spine', 'fq_name': ['default-global-system-config', 'ar-client-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.362167', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.362167', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10814950662638344474, 'uuid_mslong': 1458296463210662209}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'}, 'oper': 'CREATE', 'request-id': 'req-dba98585-fc80-4a13-9db7-02bec4b1952f', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:29.441 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 86f1ad31-9dc1-4348-93aa-c50f982e3244 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.17:8082/alarm/86f1ad31-9dc1-4348-93aa-c50f982e3244 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "86f1ad31-9dc1-4348-93aa-c50f982e3244", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.449 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'obj_dict': {'display_name': 'ar-replicator-leaf', 'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.441483', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.441483', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10101370672563146480, 'uuid_mslong': 14979107119534130494}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'}, 'oper': 'CREATE', 'request-id': 'req-b2b6838f-8f09-4d08-91e5-656c9d598962', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:29.455 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 86f1ad31-9dc1-4348-93aa-c50f982e3244 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.17:8082/alarm/86f1ad31-9dc1-4348-93aa-c50f982e3244 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "86f1ad31-9dc1-4348-93aa-c50f982e3244", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.469 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-spine"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.471 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-cf54b2e8-cf2e-4f5f-bb20-e6fa39afe79c', 'type': 'alarm', 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244'} 02/10/2025 00:47:29.479 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-92e57428-d8c5-40eb-946e-851253b09a2e', 'type': 'alarm', 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244'} 02/10/2025 00:47:29.506 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'obj_dict': {'display_name': 'ar-replicator-spine', 'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.493536', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.493536', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11905869648125488142, 'uuid_mslong': 9082196557111314575}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'}, 'oper': 'CREATE', 'request-id': 'req-da30b342-3a89-49d9-9e9f-84e5e6961ca4', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:29.555 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'obj_dict': {'display_name': 'rr-spine', 'fq_name': ['default-global-system-config', 'rr-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.550101', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.550101', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12131371124479599864, 'uuid_mslong': 15489822619118814864}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'}, 'oper': 'CREATE', 'request-id': 'req-87bdada9-e344-43fb-8daa-f1882b3b36cb', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:29.597 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'obj_dict': {'display_name': 'rr-superspine', 'fq_name': ['default-global-system-config', 'rr-superspine'], 'id_perms': {'created': '2025-02-10T00:47:29.587597', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.587597', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11074162797222856715, 'uuid_mslong': 469981172177653174}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'}, 'oper': 'CREATE', 'request-id': 'req-ce62c1a1-f9ce-4580-96f4-30ae41bd1a9c', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:29.610 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.613 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 964d465d-ed7a-400f-8517-c45857e2c37c object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.17:8082/alarm/964d465d-ed7a-400f-8517-c45857e2c37c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "964d465d-ed7a-400f-8517-c45857e2c37c", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.618 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 964d465d-ed7a-400f-8517-c45857e2c37c object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.17:8082/alarm/964d465d-ed7a-400f-8517-c45857e2c37c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "964d465d-ed7a-400f-8517-c45857e2c37c", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.639 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-a1b79ff1-d386-4861-82a1-b5be3b7d2a96', 'type': 'alarm', 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c'} 02/10/2025 00:47:29.642 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-139728d8-d5ec-44da-920e-ff5e3ca02e97', 'type': 'alarm', 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c'} 02/10/2025 00:47:29.644 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'obj_dict': {'display_name': 'rr-leaf', 'fq_name': ['default-global-system-config', 'rr-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.632649', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.632649', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13375164108578528023, 'uuid_mslong': 15950616003385443991}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'}, 'oper': 'CREATE', 'request-id': 'req-02f008b8-7544-4689-86ce-fac23d444371', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:29.676 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'obj_dict': {'display_name': 'lean-spine', 'fq_name': ['default-global-system-config', 'lean-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.671183', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.671183', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13398295008919500965, 'uuid_mslong': 3875369278223174147}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'}, 'oper': 'CREATE', 'request-id': 'req-67423df5-cd0d-4b31-923a-c65377005364', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:29.761 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'obj_dict': {'display_name': 'lean-superspine', 'fq_name': ['default-global-system-config', 'lean-superspine'], 'id_perms': {'created': '2025-02-10T00:47:29.756359', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.756359', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11993278834640437501, 'uuid_mslong': 9084216337278324174}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'}, 'oper': 'CREATE', 'request-id': 'req-2f897931-ee7e-4a2b-8059-ba9c3304473f', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:29.775 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = http://10.0.0.17:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-pnf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.780 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ed76365-e4b5-4a95-bd86-9804aecbe68f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.17:8082/alarm/5ed76365-e4b5-4a95-bd86-9804aecbe68f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "5ed76365-e4b5-4a95-bd86-9804aecbe68f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.791 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ed76365-e4b5-4a95-bd86-9804aecbe68f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.17:8082/alarm/5ed76365-e4b5-4a95-bd86-9804aecbe68f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "5ed76365-e4b5-4a95-bd86-9804aecbe68f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.809 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'obj_dict': {'display_name': 'pnf-servicechain-pnf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'id_perms': {'created': '2025-02-10T00:47:29.797269', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.797269', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11407566246657389944, 'uuid_mslong': 16972786408089276315}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'}, 'oper': 'CREATE', 'request-id': 'req-5a387e6e-ec1c-49db-8b4e-5a62019eeef5', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 00:47:29.812 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-3411043b-631e-4b8f-b301-4cf749a77ae2', 'type': 'alarm', 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f'} 02/10/2025 00:47:29.816 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-52073954-d385-49d9-b0a4-1180f08daf4c', 'type': 'alarm', 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f'} 02/10/2025 00:47:29.852 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'obj_dict': {'display_name': 'pnf-servicechain-spine', 'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'id_perms': {'created': '2025-02-10T00:47:29.845886', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.845886', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11395767288974010602, 'uuid_mslong': 59788653880755830}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'}, 'oper': 'CREATE', 'request-id': 'req-625b84fa-72d0-47d7-9e4e-42ff535df097', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 00:47:29.886 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'obj_dict': {'display_name': 'pnf-servicechain-leaf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'id_perms': {'created': '2025-02-10T00:47:29.880745', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.880745', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11009280964509902893, 'uuid_mslong': 14011958504982073337}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'}, 'oper': 'CREATE', 'request-id': 'req-5c2868de-a13e-4524-b891-1aaa6a29c848', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 00:47:29.951 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:erb-leaf:l3-gateway url = http://10.0.0.17:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf", "l3-gateway"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "use_gateway_ip", "value": "True"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.960 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ef05a83b-0fef-44fc-bdcd-3014532933df object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.17:8082/alarm/ef05a83b-0fef-44fc-bdcd-3014532933df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "ef05a83b-0fef-44fc-bdcd-3014532933df", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.962 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ef05a83b-0fef-44fc-bdcd-3014532933df object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.17:8082/alarm/ef05a83b-0fef-44fc-bdcd-3014532933df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ef05a83b-0fef-44fc-bdcd-3014532933df", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:29.980 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-d17428ae-1d3a-4257-876d-5b08cf1aa189', 'type': 'alarm', 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df'} 02/10/2025 00:47:29.983 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b8a64513-7fb4-4306-9f1c-08b578132c66', 'type': 'alarm', 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df'} 02/10/2025 00:47:29.988 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'feature_config_additional_params': {'key_value_pair': [{'key': 'use_gateway_ip', 'value': 'True'}]}, 'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'id_perms': {'created': '2025-02-10T00:47:29.973958', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:29.973958', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9475564005791236759, 'uuid_mslong': 11543112743618757444}}, 'parent_type': 'role-definition', 'parent_uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a0315fe1-ddae-4344-837f-f74273aa0297'}, 'oper': 'CREATE', 'request-id': 'req-61044008-14ac-443f-916f-9e128905eb0c', 'type': 'feature_config', 'uuid': 'a0315fe1-ddae-4344-837f-f74273aa0297'} 02/10/2025 00:47:30.031 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'id_perms': {'created': '2025-02-10T00:47:30.020442', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.020442', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11694187917302897124, 'uuid_mslong': 3278126792567181212}}, 'parent_type': 'role-definition', 'parent_uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2d7e3ef3-17a8-4f9c-a24a-19f3cb8119e4'}, 'oper': 'CREATE', 'request-id': 'req-2c72d731-a5bf-4217-be8e-83857236c95c', 'type': 'feature_config', 'uuid': '2d7e3ef3-17a8-4f9c-a24a-19f3cb8119e4'} 02/10/2025 00:47:30.073 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'id_perms': {'created': '2025-02-10T00:47:30.059590', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.059590', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12775784285328063727, 'uuid_mslong': 3290055959539044297}}, 'parent_type': 'role-definition', 'parent_uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2da8a076-b77b-4fc9-b14c-b41e55ff3cef'}, 'oper': 'CREATE', 'request-id': 'req-77ea18ab-e1ae-4a64-a1dd-7a9841f0dc48', 'type': 'feature_config', 'uuid': '2da8a076-b77b-4fc9-b14c-b41e55ff3cef'} 02/10/2025 00:47:30.085 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.17:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k-lean"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.109 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'obj_dict': {'display_name': 'juniper-qfx5k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'id_perms': {'created': '2025-02-10T00:47:30.102879', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.102879', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11786591933169557193, 'uuid_mslong': 4359244951066854263}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'}, 'oper': 'CREATE', 'request-id': 'req-f3545c68-48e7-4454-85bd-3ffe4a4d176a', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:30.127 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22540ebc-1bb6-4c67-8089-f156b03c8077 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.17:8082/alarm/22540ebc-1bb6-4c67-8089-f156b03c8077 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "22540ebc-1bb6-4c67-8089-f156b03c8077", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.130 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22540ebc-1bb6-4c67-8089-f156b03c8077 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.17:8082/alarm/22540ebc-1bb6-4c67-8089-f156b03c8077 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "22540ebc-1bb6-4c67-8089-f156b03c8077", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.149 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-eb2468de-6c5c-451e-9213-adba456c45aa', 'type': 'alarm', 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077'} 02/10/2025 00:47:30.152 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-842495f5-bc7f-48c0-8ab9-264ba0dbce9e', 'type': 'alarm', 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077'} 02/10/2025 00:47:30.181 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'obj_dict': {'display_name': 'juniper-qfx5k', 'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'id_perms': {'created': '2025-02-10T00:47:30.174602', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.174602', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9544763309912969747, 'uuid_mslong': 4705657499995882466}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'}, 'oper': 'CREATE', 'request-id': 'req-48b48b09-de4b-4570-bdb4-935e0a60f1ff', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:30.270 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'obj_dict': {'display_name': 'juniper-qfx10k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'id_perms': {'created': '2025-02-10T00:47:30.255051', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.255051', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11016818707181866209, 'uuid_mslong': 17835426777058069691}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['Route-Reflector', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1'}, 'oper': 'CREATE', 'request-id': 'req-cd0b06cb-3dc0-4007-823d-feebb570cd9c', 'type': 'node_profile', 'uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1'} 02/10/2025 00:47:30.277 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.17:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector", "AR-Client", "ERB-UCAST-Gateway", "CRB-Gateway", "PNF-Servicechain"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "Route-Reflector", "PNF-Servicechain", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.296 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7b65efe3-84e9-4738-b7e0-a3238c3cce77 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.17:8082/alarm/7b65efe3-84e9-4738-b7e0-a3238c3cce77 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7b65efe3-84e9-4738-b7e0-a3238c3cce77", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.300 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7b65efe3-84e9-4738-b7e0-a3238c3cce77 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.17:8082/alarm/7b65efe3-84e9-4738-b7e0-a3238c3cce77 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7b65efe3-84e9-4738-b7e0-a3238c3cce77", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.306 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'obj_dict': {'display_name': 'juniper-qfx5120', 'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'id_perms': {'created': '2025-02-10T00:47:30.296923', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.296923', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11837998808910603322, 'uuid_mslong': 17693119311880470554}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector', 'AR-Client', 'ERB-UCAST-Gateway', 'CRB-Gateway', 'PNF-Servicechain']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'Route-Reflector', 'PNF-Servicechain', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'}, 'oper': 'CREATE', 'request-id': 'req-0ed7b15c-8b6b-41af-a8b5-78beb6c0ecbb', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 00:47:30.317 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-84b44b68-7145-4692-8684-560892dbe93c', 'type': 'alarm', 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77'} 02/10/2025 00:47:30.321 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-9cdf50cb-5b9a-4106-b74c-8e35520d9e9e', 'type': 'alarm', 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77'} 02/10/2025 00:47:30.383 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'obj_dict': {'display_name': 'juniper-qfx5220', 'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'id_perms': {'created': '2025-02-10T00:47:30.377366', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.377366', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9858555414648999620, 'uuid_mslong': 12469233069821020148}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'}, 'oper': 'CREATE', 'request-id': 'req-36de9c86-13d3-4539-b279-7fd428b8d7e7', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 00:47:30.423 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'obj_dict': {'display_name': 'juniper-qfx10k', 'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'id_perms': {'created': '2025-02-10T00:47:30.415490', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.415490', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9859575843269757810, 'uuid_mslong': 9769554115811952235}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'}, 'oper': 'CREATE', 'request-id': 'req-491a12a5-8745-4a9b-84ea-8638a1d477fb', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:30.440 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.17:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.459 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c1ad1824-6f42-4412-8542-66c11c31f4bf object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.17:8082/alarm/c1ad1824-6f42-4412-8542-66c11c31f4bf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "c1ad1824-6f42-4412-8542-66c11c31f4bf", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.465 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'obj_dict': {'display_name': 'juniper-mx', 'fq_name': ['default-global-system-config', 'juniper-mx'], 'id_perms': {'created': '2025-02-10T00:47:30.455164', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.455164', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11639093774943829425, 'uuid_mslong': 14065505857006946183}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'}, 'oper': 'CREATE', 'request-id': 'req-b4ada3b8-a286-4f3e-ab83-f14ebdbfb81c', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:30.481 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b3fef274-bc88-4f40-b766-e9c5a9c5071f', 'type': 'alarm', 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf'} 02/10/2025 00:47:30.489 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c1ad1824-6f42-4412-8542-66c11c31f4bf object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.17:8082/alarm/c1ad1824-6f42-4412-8542-66c11c31f4bf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "c1ad1824-6f42-4412-8542-66c11c31f4bf", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.503 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-4d8db3e0-4cc0-4e06-b815-a31a34586100', 'type': 'alarm', 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf'} 02/10/2025 00:47:30.509 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'obj_dict': {'display_name': 'juniper-srx', 'fq_name': ['default-global-system-config', 'juniper-srx'], 'id_perms': {'created': '2025-02-10T00:47:30.503810', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.503810', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10666691954126076491, 'uuid_mslong': 3141647390328769673}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': False, 'node_profile_roles': {'role_mappings': [{'physical_role': 'pnf', 'rb_roles': ['PNF-Servicechain']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'}, 'oper': 'CREATE', 'request-id': 'req-d10a488b-f1ba-4713-925d-0db4dc025754', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:30.553 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'obj_dict': {'display_name': 'device-functional-group', 'fq_name': ['default-global-system-config', 'device-functional-group'], 'id_perms': {'created': '2025-02-10T00:47:30.545459', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.545459', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12364821464603039955, 'uuid_mslong': 7730809204479970042}}, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6b495a03-0b59-4afa-ab98-ab9c44ca18d3'}, 'oper': 'CREATE', 'request-id': 'req-c34f2aa2-af27-4330-8d97-2396d0cce409', 'type': 'node_profile', 'uuid': '6b495a03-0b59-4afa-ab98-ab9c44ca18d3'} 02/10/2025 00:47:30.575 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = http://10.0.0.17:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-1"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-1"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.609 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'obj_dict': {'display_name': 'default-telemetry-profile-1', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'id_perms': {'created': '2025-02-10T00:47:30.602415', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.602415', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12104153183373207611, 'uuid_mslong': 2716967658748855015}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '25b49bb0-c5f3-42e7-a7fa-973091dfa83b'}, 'oper': 'CREATE', 'request-id': 'req-5156ef85-ba7a-4089-b8d8-403e869562a6', 'type': 'telemetry_profile', 'uuid': '25b49bb0-c5f3-42e7-a7fa-973091dfa83b'} 02/10/2025 00:47:30.623 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6f2c7f5e-83ca-4645-a96c-ae42d14f0adc object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.17:8082/alarm/6f2c7f5e-83ca-4645-a96c-ae42d14f0adc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "6f2c7f5e-83ca-4645-a96c-ae42d14f0adc", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.644 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-7ab06db9-12f3-44ec-ab1b-dc63aec52e03', 'type': 'alarm', 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc'} 02/10/2025 00:47:30.670 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'obj_dict': {'display_name': 'default-telemetry-profile-2', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'id_perms': {'created': '2025-02-10T00:47:30.655107', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.655107', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11405683264048305502, 'uuid_mslong': 16557916377934351089}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'e5c98937-d766-4af1-9e49-207fae37955e'}, 'oper': 'CREATE', 'request-id': 'req-859d2ddd-4f3b-4e1c-8c1e-41719ae01d8f', 'type': 'telemetry_profile', 'uuid': 'e5c98937-d766-4af1-9e49-207fae37955e'} 02/10/2025 00:47:30.673 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6f2c7f5e-83ca-4645-a96c-ae42d14f0adc object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.17:8082/alarm/6f2c7f5e-83ca-4645-a96c-ae42d14f0adc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "6f2c7f5e-83ca-4645-a96c-ae42d14f0adc", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.700 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-776027ed-b264-4552-805a-8083796f848e', 'type': 'alarm', 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc'} 02/10/2025 00:47:30.717 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'obj_dict': {'display_name': 'default-telemetry-profile-3', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'id_perms': {'created': '2025-02-10T00:47:30.707058', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.707058', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11128995596710088968, 'uuid_mslong': 16862477845650950489}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'ea038e42-66eb-4959-9a72-228800ca9108'}, 'oper': 'CREATE', 'request-id': 'req-2520803f-ff89-48c5-9a31-c1fecb2e1531', 'type': 'telemetry_profile', 'uuid': 'ea038e42-66eb-4959-9a72-228800ca9108'} 02/10/2025 00:47:30.732 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = http://10.0.0.17:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-4"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-4"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.761 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'obj_dict': {'display_name': 'default-telemetry-profile-4', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'id_perms': {'created': '2025-02-10T00:47:30.754269', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.754269', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11738197096018734017, 'uuid_mslong': 1297264879642823421}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '1200cf88-eab3-4afd-a2e6-741133b7ebc1'}, 'oper': 'CREATE', 'request-id': 'req-cb2165c5-7f46-4f90-8b21-cf0b6c78a516', 'type': 'telemetry_profile', 'uuid': '1200cf88-eab3-4afd-a2e6-741133b7ebc1'} 02/10/2025 00:47:30.805 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c47084c-9b12-4342-853f-7bbfa17faf73 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.17:8082/alarm/7c47084c-9b12-4342-853f-7bbfa17faf73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7c47084c-9b12-4342-853f-7bbfa17faf73", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.819 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-202b871e-c034-454d-b6c4-7b1bc1054c9e', 'type': 'alarm', 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73'} 02/10/2025 00:47:30.820 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'obj_dict': {'display_name': 'default-telemetry-profile-5', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'id_perms': {'created': '2025-02-10T00:47:30.811057', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.811057', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12114224186255708691, 'uuid_mslong': 13693642361953206951}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'be09972d-1976-42a7-a81e-5eb6a7379213'}, 'oper': 'CREATE', 'request-id': 'req-1aa1cbd4-5342-475f-bb2b-f66653e34ce7', 'type': 'telemetry_profile', 'uuid': 'be09972d-1976-42a7-a81e-5eb6a7379213'} 02/10/2025 00:47:30.843 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c47084c-9b12-4342-853f-7bbfa17faf73 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.17:8082/alarm/7c47084c-9b12-4342-853f-7bbfa17faf73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7c47084c-9b12-4342-853f-7bbfa17faf73", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.856 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-4cb37837-c398-4e8c-a431-992bf2149fb0', 'type': 'alarm', 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73'} 02/10/2025 00:47:30.872 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'obj_dict': {'display_name': 'default-telemetry-profile-6', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'id_perms': {'created': '2025-02-10T00:47:30.865264', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.865264', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10317105246300572645, 'uuid_mslong': 8854832399641691749}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '7ae2af27-0e43-4665-8f2d-b88f24108be5'}, 'oper': 'CREATE', 'request-id': 'req-29c6311e-3109-4778-936a-35bec22591f6', 'type': 'telemetry_profile', 'uuid': '7ae2af27-0e43-4665-8f2d-b88f24108be5'} 02/10/2025 00:47:30.887 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-all-interfaces url = http://10.0.0.17:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-all-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "all", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-all-interfaces"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.916 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'obj_dict': {'display_name': 'sflow-all-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'id_perms': {'created': '2025-02-10T00:47:30.906831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.906831', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13326566541970893350, 'uuid_mslong': 14854164858740556075}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'all', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'ce24983d-0052-412b-b8f1-79a9a9c7ea26'}, 'oper': 'CREATE', 'request-id': 'req-b4644a53-55a5-4d6f-a489-5c86b0c971e5', 'type': 'sflow_profile', 'uuid': 'ce24983d-0052-412b-b8f1-79a9a9c7ea26'} 02/10/2025 00:47:30.953 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'obj_dict': {'display_name': 'sflow-fabric-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'id_perms': {'created': '2025-02-10T00:47:30.942114', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.942114', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11252250754435420167, 'uuid_mslong': 14210292356513156236}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'fabric', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'c535199b-e06a-4c8c-9c28-0671b5be9007'}, 'oper': 'CREATE', 'request-id': 'req-e44d8243-e846-4e73-be5f-31b7e9814da5', 'type': 'sflow_profile', 'uuid': 'c535199b-e06a-4c8c-9c28-0671b5be9007'} 02/10/2025 00:47:30.970 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f93761e4-b956-48f1-81ab-e409bcffec3b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.17:8082/alarm/f93761e4-b956-48f1-81ab-e409bcffec3b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "f93761e4-b956-48f1-81ab-e409bcffec3b", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:30.985 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-624ae190-a54f-41c1-8f31-7143d10b20ba', 'type': 'alarm', 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b'} 02/10/2025 00:47:30.990 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'obj_dict': {'display_name': 'sflow-access-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'id_perms': {'created': '2025-02-10T00:47:30.981138', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:30.981138', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11963988655210841403, 'uuid_mslong': 7985807252122193286}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'access', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': '6ed34962-9b7b-4d86-a608-a04b42a5453b'}, 'oper': 'CREATE', 'request-id': 'req-e85ea478-3309-4778-a0fd-48f238f34196', 'type': 'sflow_profile', 'uuid': '6ed34962-9b7b-4d86-a608-a04b42a5453b'} 02/10/2025 00:47:31.004 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = grpc_profile identifier_name = default-domain:default-project:grpc-default-profile url = http://10.0.0.17:8082/grpc-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"grpc-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "grpc-default-profile"], "parent_type": "project", "grpc_profile_is_default": true, "grpc_parameters": {"allow_clients": {"subnet": [{"ip_prefix": "0.0.0.0", "ip_prefix_len": 0}]}, "enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}, "secure_mode": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "grpc-default-profile"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.011 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f93761e4-b956-48f1-81ab-e409bcffec3b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.17:8082/alarm/f93761e4-b956-48f1-81ab-e409bcffec3b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f93761e4-b956-48f1-81ab-e409bcffec3b", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.032 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-0a8d806d-dcce-448a-9519-6ba4a9291222', 'type': 'alarm', 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b'} 02/10/2025 00:47:31.041 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'obj_dict': {'display_name': 'grpc-default-profile', 'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'grpc_parameters': {'allow_clients': {'subnet': [{'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}]}, 'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}, 'secure_mode': None}, 'grpc_profile_is_default': True, 'id_perms': {'created': '2025-02-10T00:47:31.033307', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.033307', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11974817989497350679, 'uuid_mslong': 18259399293790474059}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fd666aea-4e66-4f4b-a62f-198421f26a17'}, 'oper': 'CREATE', 'request-id': 'req-c2be6b08-0adb-4d3f-a056-dc4743fc924b', 'type': 'grpc_profile', 'uuid': 'fd666aea-4e66-4f4b-a62f-198421f26a17'} 02/10/2025 00:47:31.087 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'obj_dict': {'display_name': 'snmp-default-profile', 'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'id_perms': {'created': '2025-02-10T00:47:31.080830', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.080830', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12650774427509923479, 'uuid_mslong': 11819358053248027422}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'snmp_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'snmp_profile_is_default': True, 'uuid': 'a406cb87-1d00-4b1e-af90-9450ad531e97'}, 'oper': 'CREATE', 'request-id': 'req-597ebe9a-0def-45be-8fab-174179d18a88', 'type': 'snmp_profile', 'uuid': 'a406cb87-1d00-4b1e-af90-9450ad531e97'} 02/10/2025 00:47:31.130 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'obj_dict': {'display_name': 'netconf-default-profile', 'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'id_perms': {'created': '2025-02-10T00:47:31.117865', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.117865', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12278153064281112147, 'uuid_mslong': 2430272281070355325}}, 'netconf_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'netconf_profile_is_default': True, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '21ba0fc3-74ad-437d-aa64-c328d6597e53'}, 'oper': 'CREATE', 'request-id': 'req-526a3205-298f-4bc7-8df9-79f386e65e78', 'type': 'netconf_profile', 'uuid': '21ba0fc3-74ad-437d-aa64-c328d6597e53'} 02/10/2025 00:47:31.134 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f771b32f-0d19-4472-adcb-3a310619c820 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.17:8082/alarm/f771b32f-0d19-4472-adcb-3a310619c820 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "f771b32f-0d19-4472-adcb-3a310619c820", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.144 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = http://10.0.0.17:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L2-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L2 servers connectivity with ingress replication for multicast in the spine", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Access", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L2-Server-Leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.150 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-0222a443-6ab0-4ec6-bc90-41b6b9bf9916', 'type': 'alarm', 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820'} 02/10/2025 00:47:31.176 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L2 servers ' 'connectivity with ' 'ingress replication for ' 'multicast in the spine', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Access', 'AR-Client']}, 'display_name': 'L2-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'id_perms': {'created': '2025-02-10T00:47:31.166379', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.166379', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11401139977959319405, 'uuid_mslong': 18022527985863444875}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fa1ce1b7-37ed-498b-9e38-fc6774c5276d'}, 'oper': 'CREATE', 'request-id': 'req-bdafa86c-ccfc-4694-8c1b-f8c05023a70b', 'type': 'device_functional_group', 'uuid': 'fa1ce1b7-37ed-498b-9e38-fc6774c5276d'} 02/10/2025 00:47:31.181 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f771b32f-0d19-4472-adcb-3a310619c820 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.17:8082/alarm/f771b32f-0d19-4472-adcb-3a310619c820 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f771b32f-0d19-4472-adcb-3a310619c820", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.207 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-3e23b89e-63e8-4be6-99bf-5f3b64b4a804', 'type': 'alarm', 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820'} 02/10/2025 00:47:31.225 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity', 'device_functional_group_os_version': '19.1R3', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'id_perms': {'created': '2025-02-10T00:47:31.218468', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.218468', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9513772612339101098, 'uuid_mslong': 1944258797992561346}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1afb6513-5dc6-4ac2-8407-b5c8e84fedaa'}, 'oper': 'CREATE', 'request-id': 'req-b4db7f0e-90ed-4f42-9d81-8418c53071dc', 'type': 'device_functional_group', 'uuid': '1afb6513-5dc6-4ac2-8407-b5c8e84fedaa'} 02/10/2025 00:47:31.267 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'connectivity at spines', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Gateway']}, 'display_name': 'L3-Gateway-Spine', 'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'id_perms': {'created': '2025-02-10T00:47:31.257574', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.257574', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9457341290153594382, 'uuid_mslong': 15958508698558286413}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dd78031c-0a8c-4a4d-833f-39cbd73d4e0e'}, 'oper': 'CREATE', 'request-id': 'req-076929ca-bbdf-416e-80d2-525fa06f3fbc', 'type': 'device_functional_group', 'uuid': 'dd78031c-0a8c-4a4d-833f-39cbd73d4e0e'} 02/10/2025 00:47:31.280 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = http://10.0.0.17:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Storage-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 connectivity to storage arrays", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Storage-Leaf"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.300 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7e4d3ead-0b84-43a1-95b2-684d72fb99bd object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.17:8082/alarm/7e4d3ead-0b84-43a1-95b2-684d72fb99bd operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7e4d3ead-0b84-43a1-95b2-684d72fb99bd", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.305 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 connectivity ' 'to storage arrays', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Storage-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'id_perms': {'created': '2025-02-10T00:47:31.294719', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.294719', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11170979631492777065, 'uuid_mslong': 84117242785712022}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '012ad82f-c7ba-4796-9b07-4ac9d8404469'}, 'oper': 'CREATE', 'request-id': 'req-df649599-6c9c-426b-944f-f038419be4ba', 'type': 'device_functional_group', 'uuid': '012ad82f-c7ba-4796-9b07-4ac9d8404469'} 02/10/2025 00:47:31.315 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-c44fffb2-c73e-42e0-a4ee-0edfff1b6da3', 'type': 'alarm', 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd'} 02/10/2025 00:47:31.335 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity with ' 'Optimized multicast ' 'traffic', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway', 'AR-Client']}, 'display_name': 'L3-Server-Leaf-with-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'id_perms': {'created': '2025-02-10T00:47:31.329256', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.329256', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12884170353202122402, 'uuid_mslong': 15284487261036432025}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd41d682e-e80f-4a99-b2cd-c4ac483b4ea2'}, 'oper': 'CREATE', 'request-id': 'req-58735c44-15f7-4560-9d90-deae354ad689', 'type': 'device_functional_group', 'uuid': 'd41d682e-e80f-4a99-b2cd-c4ac483b4ea2'} 02/10/2025 00:47:31.348 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7e4d3ead-0b84-43a1-95b2-684d72fb99bd object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.17:8082/alarm/7e4d3ead-0b84-43a1-95b2-684d72fb99bd operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7e4d3ead-0b84-43a1-95b2-684d72fb99bd", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.359 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-d60f12d7-cb6d-4438-b30d-b7593031e835', 'type': 'alarm', 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd'} 02/10/2025 00:47:31.412 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing ' 'for L2 server leafs and ' 'route reflector and ' 'ingress replication, as ' 'well DCGW and DCI GW and ' 'connectivity to ' 'firewalls', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'id_perms': {'created': '2025-02-10T00:47:31.402998', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.402998', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13002787510855127764, 'uuid_mslong': 17063873847341302626}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eccf0edb-1adb-4362-b473-2e597267d2d4'}, 'oper': 'CREATE', 'request-id': 'req-9d72dac4-1558-4050-aaf3-50dd0df9e722', 'type': 'device_functional_group', 'uuid': 'eccf0edb-1adb-4362-b473-2e597267d2d4'} 02/10/2025 00:47:31.463 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd30bb3-7cae-4b9d-ac01-599e99ff42dc object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.17:8082/alarm/bbd30bb3-7cae-4b9d-ac01-599e99ff42dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "bbd30bb3-7cae-4b9d-ac01-599e99ff42dc", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.467 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = http://10.0.0.17:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine-With-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing and gateway services for L2 server leafs ; provides route reflector and assisted replication", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "AR-Replicator", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine-With-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.476 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-5745746c-1c3b-4cd2-9134-a8408b1d93f4', 'type': 'alarm', 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc'} 02/10/2025 00:47:31.490 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing and ' 'gateway services for L2 ' 'server leafs ; provides ' 'route reflector and ' 'assisted replication', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'AR-Replicator', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine-With-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'id_perms': {'created': '2025-02-10T00:47:31.483387', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.483387', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10893531763931172496, 'uuid_mslong': 18244119821695601386}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fd302250-fbd4-4aea-972d-996c428d4e90'}, 'oper': 'CREATE', 'request-id': 'req-e073c85d-49e8-49cf-afa6-72f93043b372', 'type': 'device_functional_group', 'uuid': 'fd302250-fbd4-4aea-972d-996c428d4e90'} 02/10/2025 00:47:31.508 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd30bb3-7cae-4b9d-ac01-599e99ff42dc object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.17:8082/alarm/bbd30bb3-7cae-4b9d-ac01-599e99ff42dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bbd30bb3-7cae-4b9d-ac01-599e99ff42dc", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.521 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-81eb6e3b-27bd-4b01-bc91-80d3e31e21b6', 'type': 'alarm', 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc'} 02/10/2025 00:47:31.525 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Spine-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'id_perms': {'created': '2025-02-10T00:47:31.516305', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.516305', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13624269360937944751, 'uuid_mslong': 8995959810386971930}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7cd811c8-efce-4d1a-bd13-20cc9ef1c6af'}, 'oper': 'CREATE', 'request-id': 'req-90117207-c2e8-4681-89f6-5831be4cfdd6', 'type': 'device_functional_group', 'uuid': '7cd811c8-efce-4d1a-bd13-20cc9ef1c6af'} 02/10/2025 00:47:31.600 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Leaf-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'id_perms': {'created': '2025-02-10T00:47:31.593967', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.593967', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11479837537628976139, 'uuid_mslong': 13504097232240460950}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bb6830e2-8c07-4496-9f50-936aed91f40b'}, 'oper': 'CREATE', 'request-id': 'req-0ec6080b-534c-409a-88b2-d96c4838faef', 'type': 'device_functional_group', 'uuid': 'bb6830e2-8c07-4496-9f50-936aed91f40b'} 02/10/2025 00:47:31.616 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = http://10.0.0.17:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Lean-Spine-with-Route-Reflector"], "parent_type": "project", "device_functional_group_description": "Spine only acting as Route Reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "lean"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Lean-Spine-with-Route-Reflector"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.628 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7167e02f-cb20-4602-858a-23c3f9219cf2 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.17:8082/alarm/7167e02f-cb20-4602-858a-23c3f9219cf2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7167e02f-cb20-4602-858a-23c3f9219cf2", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.639 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-f0f589e5-0610-43db-928e-0706745bbfbe', 'type': 'alarm', 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2'} 02/10/2025 00:47:31.642 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'obj_dict': {'device_functional_group_description': 'Spine only acting as ' 'Route Reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'lean']}, 'display_name': 'Lean-Spine-with-Route-Reflector', 'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'id_perms': {'created': '2025-02-10T00:47:31.634760', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.634760', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12148875813665983090, 'uuid_mslong': 3206221638869271159}}, 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2c7ec997-dff9-4277-a899-7a2f5de54a72'}, 'oper': 'CREATE', 'request-id': 'req-f86c925a-4cfc-43bf-9a1a-d936a97f1522', 'type': 'device_functional_group', 'uuid': '2c7ec997-dff9-4277-a899-7a2f5de54a72'} 02/10/2025 00:47:31.664 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7167e02f-cb20-4602-858a-23c3f9219cf2 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.17:8082/alarm/7167e02f-cb20-4602-858a-23c3f9219cf2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7167e02f-cb20-4602-858a-23c3f9219cf2", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.675 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-7e29f38f-b2ef-4c4b-b2f7-ce63031087e6', 'type': 'alarm', 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2'} 02/10/2025 00:47:31.732 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.724538', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.724538', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13071051151268617746, 'uuid_mslong': 1634963439227849740}}, 'parent_type': 'node-profile', 'parent_uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '16b08e95-e7ed-4c0c-b565-b3c4c8539e12'}, 'oper': 'CREATE', 'request-id': 'req-364190c3-5482-49cd-9c4f-79b66b83409c', 'type': 'role_config', 'uuid': '16b08e95-e7ed-4c0c-b565-b3c4c8539e12'} 02/10/2025 00:47:31.785 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.780536', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.780536', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11428709622971446643, 'uuid_mslong': 142277455844295950}}, 'parent_type': 'node-profile', 'parent_uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '01f97897-9f25-450e-9e9a-eed9a64d3573'}, 'oper': 'CREATE', 'request-id': 'req-d7b4d3c1-7a7c-433e-9edc-97c5f0de99e6', 'type': 'role_config', 'uuid': '01f97897-9f25-450e-9e9a-eed9a64d3573'} 02/10/2025 00:47:31.795 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bc1530f8-d883-45f8-9a25-132b83db8fbe object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.17:8082/alarm/bc1530f8-d883-45f8-9a25-132b83db8fbe operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "bc1530f8-d883-45f8-9a25-132b83db8fbe", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.805 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5120:basic url = http://10.0.0.17:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.816 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-32d7d97a-c55a-47a8-ba00-6407686de38c', 'type': 'alarm', 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe'} 02/10/2025 00:47:31.824 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bc1530f8-d883-45f8-9a25-132b83db8fbe object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.17:8082/alarm/bc1530f8-d883-45f8-9a25-132b83db8fbe operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bc1530f8-d883-45f8-9a25-132b83db8fbe", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.834 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.828190', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.828190', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11744434859269211476, 'uuid_mslong': 11133845858808515483}}, 'parent_type': 'node-profile', 'parent_uuid': 'f58a9645-a13d-401a-a449-0532409d243a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '9a835dd1-a63c-4b9b-a2fc-9d47a274c554'}, 'oper': 'CREATE', 'request-id': 'req-4fb41688-aef6-4d26-a85e-b99cdb511507', 'type': 'role_config', 'uuid': '9a835dd1-a63c-4b9b-a2fc-9d47a274c554'} 02/10/2025 00:47:31.862 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-13b66a82-04c2-4796-b889-c4091abd3acb', 'type': 'alarm', 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe'} 02/10/2025 00:47:31.889 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.883298', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.883298', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12127683654914823240, 'uuid_mslong': 13393920122813368381}}, 'parent_type': 'node-profile', 'parent_uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'b9e0c363-3e3f-483d-a84e-300767825448'}, 'oper': 'CREATE', 'request-id': 'req-f91345b9-d96b-428a-8c08-b532257086e3', 'type': 'role_config', 'uuid': 'b9e0c363-3e3f-483d-a84e-300767825448'} 02/10/2025 00:47:31.924 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.919724', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.919724', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11170673622529745839, 'uuid_mslong': 1761629154166852689}}, 'parent_type': 'node-profile', 'parent_uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '18729061-d816-4c51-9b06-347994b623af'}, 'oper': 'CREATE', 'request-id': 'req-96d98ed3-913a-4d5a-8c46-29578ea7c924', 'type': 'role_config', 'uuid': '18729061-d816-4c51-9b06-347994b623af'} 02/10/2025 00:47:31.940 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k:basic url = http://10.0.0.17:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.966 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.17:8082/alarm/2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:31.977 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:31.969639', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:31.969639', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11680490376520460431, 'uuid_mslong': 5949348954980240487}}, 'parent_type': 'node-profile', 'parent_uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '5290555a-8270-4c67-a219-701c8edee88f'}, 'oper': 'CREATE', 'request-id': 'req-6588e306-ed63-420a-97a1-43bf3251d037', 'type': 'role_config', 'uuid': '5290555a-8270-4c67-a219-701c8edee88f'} 02/10/2025 00:47:31.990 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-c40b2919-71bd-441e-91ab-17eb8d3d7cd8', 'type': 'alarm', 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4'} 02/10/2025 00:47:32.012 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.17:8082/alarm/2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:32.057 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-0eee6b7d-1ee8-4d4a-910a-e93ff8193a9b', 'type': 'alarm', 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4'} 02/10/2025 00:47:32.088 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:32.078687', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:32.078687', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12840122366697999954, 'uuid_mslong': 4786814851081325370}}, 'parent_type': 'node-profile', 'parent_uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '426e2ebe-d444-4b3a-b231-47433b950e52'}, 'oper': 'CREATE', 'request-id': 'req-901696dd-dbbe-4742-9819-7e0738aafaec', 'type': 'role_config', 'uuid': '426e2ebe-d444-4b3a-b231-47433b950e52'} 02/10/2025 00:47:32.132 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'id_perms': {'created': '2025-02-10T00:47:32.125941', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:32.125941', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10500612454580098481, 'uuid_mslong': 14100348575390975609}}, 'parent_type': 'node-profile', 'parent_uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'c3ae8052-8d5d-4679-91b9-ab648f4a15b1'}, 'oper': 'CREATE', 'request-id': 'req-5fd01110-4c44-4218-af7d-09d9123a6c61', 'type': 'role_config', 'uuid': 'c3ae8052-8d5d-4679-91b9-ab648f4a15b1'} 02/10/2025 00:47:32.139 7fe2411e4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.17:8082/alarm/a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "a5c5a4c8-d067-4b39-8ab4-f2ba87f92191", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:32.158 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-680d9415-3079-4905-b72f-4ce7b0a523fb', 'type': 'alarm', 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191'} 02/10/2025 00:47:32.170 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-24159b02-a2cb-4b71-8bf4-6f90b531a16f', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.200 7fe2409c32e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.17:8082/alarm/a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "a5c5a4c8-d067-4b39-8ab4-f2ba87f92191", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:32.212 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-2b3961bc-4a2b-4b33-a7a7-9f6b93b45e61', 'type': 'alarm', 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191'} 02/10/2025 00:47:32.241 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b8c6d0bc-502c-4e9c-a63a-d2aac5522a44', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.316 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ce7a2121-ca71-459d-a7cf-d49e6f5d586e', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.393 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-baaaa672-141a-4876-8316-e93fce4cc3cc', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.419 7fe2408f6390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:32.421 7fe2408f6390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:32.422 7fe2408f6390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:32.460 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bec3d673-fcd8-4e23-9f49-efd1623079a3', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.545 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c7ee245c-46ac-4ced-a504-8fdb602c8765', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.613 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7598774e-19a5-4549-99a1-a6573bcd5be9', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.689 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-44792349-cc14-4775-8c13-59a228ac9c06', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.778 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fe75da78-5bb3-47eb-9821-e6342f867caf', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.882 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-80ab1e70-4811-438b-8220-95c916f136f1', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:32.999 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-971dc9d1-d10d-43f6-ae9a-616f5fbdbe26', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.085 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2f163f1c-327d-4a39-8545-c83953ae343d', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.179 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-71e51bd6-5a36-4a8d-8a07-a04bf8b7f347', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.249 7fe240805978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:33.261 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-d7671906-6bf3-452a-930a-a820a697fe98', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:33.267 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8b0a40e3-4e86-4c45-8917-aeba06b2336b', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.272 7fe24072fb70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:33.282 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5375768a-b9f1-4eb2-ae54-5256a9cb16bc', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:33.343 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-41b14964-94e8-4714-b9f8-fe4756c4857e', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.419 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-dd35406d-62a6-4e3b-85a0-0a4098112416', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.498 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d33baf2d-fa2c-439a-9e31-37d672a2f534', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.572 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-32c2483b-2940-4bfc-9ec4-72ccf73b059e', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:33.649 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-129a9d42-b40f-4520-b813-b1992fd45e98', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:33.730 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-05f565dc-0ea1-4f81-acb3-ba9ad3e0d79c', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:33.813 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-5ab6d543-88ff-4aa4-80b6-a50fda1eeb26', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:33.886 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-df421bbd-64e9-4f8f-8db4-a1a51dc3c3e0', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:34.014 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-e18947b7-1868-443c-a412-4cdd82b8185d', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:34.104 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ce89c163-00e7-497b-a9b2-1062f97804a2', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:34.181 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-49178865-f89c-41c2-a165-2f518ce36a16', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:34.260 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-6ce5b928-ed93-46e1-a1da-db57153556c9', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:34.349 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-5bfbd6a3-f052-42ad-8e09-21eba4149f13', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.401 7fe24084d780 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:34.414 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-48f912f0-55cb-455d-8ef6-6afaa771c34c', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:34.416 7fe24084dac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:34.425 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-fef0bbd9-487d-43d2-9291-a164eff06f5e', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 00:47:34.427 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-bd2d1aea-8a08-4b2b-8686-27865b56ec4b', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.508 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-9db1c47b-0a5e-4d2b-be36-1d67871cd634', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.579 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8abdb305-f2bc-4d4b-8b00-246d13ac1d4b', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.650 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-f4d45aad-f8ff-408d-9054-de5ac79c4909', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.725 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-9b2d64c7-0b77-4da9-9072-9c792ca4835a', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.809 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d0f598b4-a1d5-438e-9f3d-6746063829b0', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.878 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-10d7bf5c-af16-4ecb-8632-46b3a5a12aab', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:34.954 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7f3b44f3-345b-4b67-9587-47445c4a2369', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.029 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6f2270d0-1da9-4662-b016-baba620d2354', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.104 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-251189f2-8d20-4119-8d52-aa5350d1a141', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.189 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5ab0d76c-9447-4ee9-ad45-95141e7f6e98', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.268 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a1ad82ca-8b2c-4199-a2e7-923bcdfab983', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.363 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f3164d86-f658-4b5d-9747-5addb8f3fd99', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.446 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f47a1973-cb2c-413a-a897-dd2d8ed8ab46', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.533 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4a3fc8bb-86e8-410c-b4b0-788268063b25', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:35.615 7fe2407d5a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:35.625 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7a356f24-e360-4741-b633-6ea7b0f20951', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:35.667 7fe240896a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:35.703 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-f6557e14-e69d-46c7-972e-0c66cad556ad', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:47:35.732 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-063cfa34-8e8b-4ce6-a3bd-56ef5721fa30', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:47:35.742 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3bd2205e-6258-43ec-902f-d80d53fb5eda', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:35.810 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e3937a04-3ba6-468a-a42b-7aeed5948c0d', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:35.888 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-6ceae4a6-b61b-4a7a-b1ae-e960f727e040', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:35.984 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d2bede5b-98d8-45e5-96a8-dd7e78d9ae8a', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:36.061 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-82cebd6e-fec1-4b7f-a8c9-85ef42f417d9', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:36.145 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a06a761c-1475-4aca-a383-700534105a4e', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:36.225 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-611f08ce-1de5-4495-b72d-f1abfb637275', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.299 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1c1285b6-387f-490a-985c-891f0f31f4ab', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.375 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4a651430-f167-4b98-9a13-d02682c7d4dc', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.421 7fe240754048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:36.422 7fe240754048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:36.422 7fe240754048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:36.422 7fe240754048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:36.423 7fe240754048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:36.446 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1e1f9610-8050-492a-94bf-64af7ca4fc61', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.516 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5d2287d5-a49d-4bea-b4b9-cb0a2ec33523', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.601 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c0d5943f-938f-4708-8349-75ac83a52a36', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.685 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9b3f02a2-23ce-4e05-a722-8fef82e275bc', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:36.787 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d6e97d87-60d4-4b0a-812d-6349b3d3ac7e', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:36.867 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-764c5479-eda4-4532-89f8-3788e4dd91dc', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:36.956 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-86834072-d1f3-4aa2-8d64-b751f8e26e37', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.049 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b9c15295-b27b-4665-9df3-b5c3af3e3784', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.128 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8838ad6a-0662-45a9-a539-227284f0c31c', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.214 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-eaafdb53-c002-4c1e-8989-2c151fc8399a', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.295 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c0bd1fcf-55b6-4b47-a6aa-67d272ad412b', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.401 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3563347c-a3a5-471e-94b3-7a8e40b8a98f', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.487 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-5f39e38d-c5dc-4959-897c-3829ec3757e3', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:37.584 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-28a0c2c8-d046-48f0-a9e7-2dd409015892', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:37.667 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-04b674f2-69a9-4e6c-864a-5e1949e775ab', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:37.759 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-e582f7c9-db61-428c-aeb8-a7dcc531105c', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:37.846 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-824b2fd1-24e0-4429-b822-4e99915650ce', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:37.927 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-28bc8b6e-ea17-443c-a682-904127d68b46', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 00:47:38.011 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-d5dc6f10-fb69-47f8-ad03-0aaad6e3a1ca', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:38.078 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-8f37e95d-ad9b-47e1-a4b0-5435f45547e6', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:38.146 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-78f3c6a0-3d3e-4b47-8e6d-13e98b1af6b7', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:38.231 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0a248c33-7438-40d9-bffd-031319a6c58e', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.305 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d78b771a-e53b-4d7c-b742-3d69ddf4d1aa', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.389 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-22d07f8f-da02-4213-b2f8-a6f302df9fee', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.473 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ff3efe61-13ad-4740-859f-8d4b88438b0d', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.563 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-046d5568-e072-4d54-93ca-6a1e49eb5ac2', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.657 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-af682532-e9eb-4427-92a0-b870362add09', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.738 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-77ed7ddf-8d26-4901-aea0-76b44c0f103e', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.834 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7f513440-86c6-4400-a3c0-f63e46a39bc1', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:38.934 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-46f0fd2c-d19b-4f28-8230-ac52ffe732b5', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:39.008 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a9f009a5-635c-45ba-8074-4cb7f8b8b3ce', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.077 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-01fbd44e-ddee-4d9a-85fa-0522affbf502', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.160 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-930d43f0-6784-4e97-93f4-4574b1597aec', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.230 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-44e2b7e0-e7a1-43c2-ae9d-0962e3f2f078', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.298 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3598aa19-a747-4964-9541-5c77869a1f6e', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.373 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a25afb02-6e3d-4336-8ec0-43c1e20d9876', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.447 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0f18ac17-9377-4820-8cc6-801770bf4aa3', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.515 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-820db7ce-1b67-4b9a-9f7d-d500aad18d23', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.594 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e0736fe7-7f65-4913-bd11-27a5932706b6', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:39.666 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-de14dbde-7380-4552-9555-807b7511e3e3', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:39.739 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-60fd31d9-110a-4900-89b2-1792a414c651', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:39.811 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0e40c635-947b-4c47-a539-7423b750fd19', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:39.884 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e8fd77ee-8c8c-4d8e-9f13-a892ce011792', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:39.950 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d193a954-dfc7-4b82-81df-90370f887211', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:40.022 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-67cc1054-45ce-4322-b8f8-44352d78e33a', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:40.095 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-87a38986-55fc-4e90-8558-02482e890ed4', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:40.171 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7082243c-b1d7-4d17-8d2f-e6a70b043a53', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:40.239 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-656cd71e-0089-4c70-b0b5-d24eda812ece', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:40.318 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-d176c37f-ed9d-4feb-816b-3252e00017a5', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:40.377 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fce9965c-5f02-43e6-81be-b6e531f1a169', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:40.423 7fe240761c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:40.424 7fe240761c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:40.425 7fe240761c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:40.452 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-353c0e76-6b25-4218-be83-e0fc8599526c', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:40.521 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-49ab15a7-33b5-4096-865e-33a87ec7931a', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:40.594 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-c527783c-d6a8-4c2d-abc3-c50a0e92e1c8', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:40.671 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-af300d7d-4a0f-49e4-ad16-c57ed3798a57', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:40.741 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-fe32c640-e552-45ad-b124-15b013affb8b', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:40.813 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a6c624a7-818d-4d46-acb0-627d5df1da31', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:40.887 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4be399d4-1431-4685-9697-3ba9f8465b0d', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:40.969 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-8eb40b39-13c2-4784-a3b9-a3af0d5f208e', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:41.042 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-1abbe169-c2b5-4582-9697-9727b3185c83', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:41.110 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b71abed9-896c-4931-bb1c-5c3df45a624d', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:41.189 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-be7f858f-21b2-43a0-a3f0-fabb365ae587', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:41.257 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-78c8d9fc-d2d5-4e4d-801c-774ff332be32', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:41.335 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-1f7b5275-3872-495b-ac9e-e204f5a95000', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:41.402 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-43d656b5-7b19-47fd-866b-f929f8f38bc8', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:41.472 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a0c49db4-4ac3-443b-8d03-d1d08fece7e3', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:41.579 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-3b3bb80e-212b-43d1-9321-af0528edb873', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:41.682 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-b86bc89e-f6e5-49ed-aae4-8a0888ffc630', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:41.767 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-8d3d0ee0-da78-457a-97be-1251293a5479', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:41.845 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a56225fc-876c-4d7e-9733-fb13b26c84df', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:41.956 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-1ed9185a-0b7b-4982-8a33-04f74e864093', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:42.037 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-494e5a55-04a9-4284-b3e6-e9e373a90aba', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:42.136 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-52925d1e-0625-4f7c-8f28-847dcecc2bca', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:42.217 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-24a015e3-a3e1-4e69-959e-35af17bb2076', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:42.319 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-f4b8d586-6525-406f-9c1c-6b172be270e9', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:42.418 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-672addcb-ac60-4802-bfa0-ec45eea19e4a', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 00:47:42.536 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-65b5eeda-aab3-4b1b-bc94-41169127d828', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:42.645 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-d3c1765e-260a-49c7-a862-3565f1b9bbb5', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:42.724 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-e4c5dc0a-05a2-46d3-9b90-aef022dc4df6', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:42.882 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-a3538dae-2819-4e58-b5ab-fbf92632131b', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:42.953 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9c8ce8c7-1717-4094-90b3-8282a85b37e1', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:43.029 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e271837b-004e-40ff-b006-0230dcb30576', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:43.103 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4a73270b-272a-4e65-9784-5988ff5953e0', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:43.173 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-724741c7-565c-4add-b5ca-e9c9482b051e', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:43.249 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-578dd3fd-b7ae-4456-bf2f-11b37239b5b6', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 00:47:43.321 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7b2e28d9-09b4-48e9-ac59-f21ba8e4c801', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 00:47:43.402 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-34237d64-db2e-4a69-9d3d-bbd2914f2ad3', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 00:47:43.480 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-68457f67-71ce-4a52-a354-8ea532f553ac', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:43.588 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-43d3c1b5-3bda-4319-9252-7e399b46b2d9', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:43.685 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8f20d1e7-5fde-41a1-a99f-edb80dc59f8e', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 00:47:43.800 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-73c8f0d0-6593-452d-b1f9-6170573fb7bc', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 00:47:43.901 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8f3745f5-dd34-405d-b1de-8c74f7b2df51', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:43.995 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-50415c68-242a-4a8a-b115-20f0049e91f1', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:44.085 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-356ca6ee-64c4-4c2a-bfde-d7b7f1a894d9', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 00:47:44.182 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-72be1fc9-eafc-49f5-8e56-d4ce16d076aa', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 00:47:44.258 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8c0dcde4-ebdb-4329-96c6-b232fee007f5', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 00:47:44.337 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-5d78271f-c1a9-4536-b26a-088dad2fbeef', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 00:47:44.412 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5fd17e45-59d0-4fbb-aab4-b161c231fd7b', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 00:47:44.425 7fe2407d74e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:44.426 7fe2407d74e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:44.427 7fe2407d74e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:44.490 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-7908f120-cbbe-4dd1-a62f-10abca7d0d1e', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 00:47:44.563 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-19712c66-0a87-41e5-bdd6-fd588318a273', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 00:47:44.632 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3fd4e111-5188-485c-946b-04906e9313bd', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 00:47:44.708 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-08fcd7bc-f804-4e54-be92-1b3fa9467502', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:44.779 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4be1e8da-e004-45d7-917b-75701596b33b', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:44.895 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2b6b5adf-f5ea-4ca5-8d47-f109642d24f7', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 00:47:44.979 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7f661456-8761-469e-b0f8-19f04de41c4c', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:45.066 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fceafb74-f4a2-436a-8b61-d8f1accfdfd7', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 00:47:45.149 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c66335ec-db2f-4d87-8fb5-4d493a1dc129', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:45.219 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-92e65980-6d92-4e82-8c67-c52f3e8469bf', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 00:47:45.289 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-995cb92c-0f77-4926-bb67-2ede53c31142', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:45.358 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-81f876f1-f508-490d-b102-92688c27d7c5', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 00:47:45.428 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-cf0ca917-7fc7-4377-93cb-dcc69bb5c8ff', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 00:47:45.500 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-eb4ad5f7-0343-49f2-ac2d-362473a919a7', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.571 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-4a9dcb55-eff2-4544-819b-cd877ff0aafe', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.640 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a40b1659-0d8d-40f1-99cb-db5a85b83e3e', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.718 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-2c1fa266-f529-4f33-9790-51dd731de87b', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.791 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-c94c3efd-5292-437e-98ab-ab872473a18a', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.864 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-8d8d5ab0-cd1c-40ae-99d5-339df8c38395', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:45.939 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-dce4c7f7-9cce-49e9-928f-dcc7d61b4a76', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:46.016 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-303fdcc0-9124-45e2-ad5c-f8b21f6e688c', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:46.090 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-b2a831d3-47dc-4013-9f19-427294dfee77', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:46.165 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-7e8b155c-1c37-4843-944a-63441f4a5b9d', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:46.233 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-8790298d-bbeb-46de-8e99-ed24a0fb925a', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 00:47:46.310 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-13de62a6-078a-4db9-8edb-2c0348dbe74d', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 00:47:46.381 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-b01e4ae8-be91-4620-ab2f-df84afb89d78', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 00:47:46.455 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ed3fb482-0a3e-49ad-a441-96d21d430475', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 00:47:46.526 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-1fe88cc3-0c4b-43d1-94b8-d5468eae0081', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 00:47:46.600 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-73a852bd-11e6-4aba-a9d7-9c78f021b7ca', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 00:47:46.674 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bfdc2f3e-a179-4079-9550-442ff2fe7c65', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 00:47:46.748 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-fa2b7e01-dabf-4da1-a59a-036f752abb8f', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 00:47:46.821 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-629dc583-5f21-468c-b24a-e3f1ee7feab2', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 00:47:46.891 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5ef3c268-07f8-4b0d-a2b5-34eec174f316', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 00:47:46.965 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-9e2ddb2e-b1ac-4263-b852-f4f4135e0e3e', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.035 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-97e65256-c315-43b4-9b79-74224eed4c21', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.116 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-94077ebe-52d0-404d-87ee-b3768e0af9a8', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.212 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-00111614-cbf5-4cbd-9aa6-5d0f521582e2', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.310 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-68fb9a0f-1922-4807-babc-dd9fe6a969cb', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.415 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-96f317cb-cefd-4594-aebb-b8f8e4a9578a', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.483 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-97cdfe4e-5389-494c-ab84-ec9d8c07ccde', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.561 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-2ced4adf-01b0-49ed-aff8-4d4641a94a41', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.635 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-07e01e04-9db2-40ea-8f6c-dc4cd8c8ed63', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.707 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-acdf50fd-68a8-462d-9224-2b3d03f6a146', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.779 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-acfc73b0-96bd-4d5c-a58a-4aabaac84936', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.848 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-82d80b7d-dd9a-40bc-a183-b06abecbf167', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.920 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-33f4a036-75c7-4fce-aeb4-6e9d475cc0bf', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:47.992 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-6d7f3217-4ec2-4382-aa3e-3aa08401a411', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:48.102 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-771c8a2f-2641-476a-9a90-16853c8befef', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:48.188 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-1e11f56e-d891-4801-9151-18636b7bddf7', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:48.327 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-8da27121-1cf7-44fa-a108-2ce1459e9e54', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 00:47:48.427 7fe2411e40f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:48.428 7fe2411e40f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:48.429 7fe2411e40f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:48.451 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-e893e32b-807e-4902-9c61-63c5cbf926ca', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 00:47:48.528 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-bf3d14f2-33b0-44ff-8cde-45429d876e33', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 00:47:48.610 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-9ad60331-fdcc-4d5f-b7b0-fc6137b78526', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:48.682 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-369ac558-af10-4631-9c9a-fc04137be661', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:48.755 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-49b0bb41-f89d-4d58-a883-38a489069e4b', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:48.826 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-61c48dae-56de-4cca-a770-f29f2a67f520', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 00:47:48.901 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-71c227a6-248d-4afe-a4b0-e985a7c1961c', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 00:47:48.978 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-a75700ed-3c67-496d-b56a-df479a0e6f4a', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.055 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-d0f22173-9d3b-4b44-8851-dddab22d0562', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.122 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-7675e274-aa4f-48c9-b9e8-4fed56516d79', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.195 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-dc6283a3-d3e4-4e87-ae0c-5d93deb9679a', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.264 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-c5c3c0eb-1a99-4ce0-a153-a417fd62f14e', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.341 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-214e8fe4-be6d-4cb8-98cc-e39052c0c7c5', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:49.413 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2f1fb6d5-4eb3-434f-9213-2684924cf225', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.490 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-fc6c7f84-d4bb-492a-8706-d98dba4c10f1', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.561 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-7062bdc9-4bb6-46c5-9930-2a3ccf15e7c3', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.634 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-bec96f2e-5d5e-49c9-9380-89d2b42567e0', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.720 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d86bfece-d68e-47b4-870e-cda76c127697', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.795 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-88081806-5c73-4076-a409-22903e0ae95b', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.872 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d1646c91-54eb-42b4-8b79-ca650dc20f25', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:49.948 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a6b4ac97-4241-48bd-b945-b88135d66bc8', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.032 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-530b30d4-993e-4f7a-9a0c-c6c7921ad4ee', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.109 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-81035b03-9fdb-4f3d-8d8b-cee6ca36182f', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.182 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-146e4379-623d-4178-9510-a4d6ebaca04b', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.285 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-b0f26509-0458-4755-8e62-a9ea31a36421', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.364 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a4bb3d6b-ccda-4f55-954c-9b8de4a2c012', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:50.466 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-cfe392e3-8e3e-4d6b-856a-aa0321a8795c', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.539 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-a5c407d7-2c2e-4533-8228-a02ece6dc39e', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.609 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4f7e32b3-024d-46e4-9a9b-34b9577a931c', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.683 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-879dbed8-e8fe-4c26-b82d-e5779c104cae', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.753 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-50a6c5c1-3657-4ff1-86fe-6183b18b9ecf', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.825 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-c12d977f-559e-4251-8038-a381793230cc', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:50.944 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-f7e6bb28-f233-4e1c-960a-3004a5291f92', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:51.018 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-27bcae35-795c-42b6-a1d5-570380bf90da', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:51.094 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-28cc1bb1-f01d-43c0-a4c0-690bfc46137b', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:51.179 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-f1f94b7b-34c7-48d2-8f30-40ea3321fded', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:51.249 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-1d4b6d77-c654-4c4d-a387-b216b5dfed30', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:51.352 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-3c973b8f-757c-4f44-9212-e1f5f196c3c7', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:51.398 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-93a8a81e-4cf5-4347-a6ad-da7197654f82', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 00:47:51.508 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-db1b2ba3-8fab-46ec-b4d0-ccb2e2c76786', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 00:47:51.608 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-08576326-0260-4fb1-b832-2896b5b5ee19', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 00:47:51.702 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-28e581cb-7351-48e7-8be2-a4914e1ecbe0', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 00:47:51.820 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-83e2679f-4395-4e30-9dfa-8b8bb9ae297d', 'type': 'node_profile', 'uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1'} 02/10/2025 00:47:51.905 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-d9cba8cf-6534-4d55-987c-f005b566c7fd', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 00:47:51.981 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a2be3eb9-244e-4ad6-b574-bb92779f18c9', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 00:47:52.070 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-82a14ecf-da42-4df7-9583-7d7ac3829525', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 00:47:52.158 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-0cf8edda-11be-46bb-bda5-e057ed2aba30', 'type': 'telemetry_profile', 'uuid': '25b49bb0-c5f3-42e7-a7fa-973091dfa83b'} 02/10/2025 00:47:52.250 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-304bfa29-9030-40d9-b504-a71f99b93351', 'type': 'telemetry_profile', 'uuid': 'e5c98937-d766-4af1-9e49-207fae37955e'} 02/10/2025 00:47:52.338 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-e6e664eb-1077-4564-a0f2-567284059006', 'type': 'telemetry_profile', 'uuid': 'ea038e42-66eb-4959-9a72-228800ca9108'} 02/10/2025 00:47:52.428 7fe2408ea588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:52.429 7fe2408ea588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:52.429 7fe2408ea588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:52.429 7fe2408ea588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:52.430 7fe2408ea588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:52.442 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-1dd6386e-777d-4816-8722-974260c52f9c', 'type': 'telemetry_profile', 'uuid': '1200cf88-eab3-4afd-a2e6-741133b7ebc1'} 02/10/2025 00:47:52.563 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-45e64b59-fad7-48c5-b9ef-83773d85db0d', 'type': 'telemetry_profile', 'uuid': 'be09972d-1976-42a7-a81e-5eb6a7379213'} 02/10/2025 00:47:52.640 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-90b4ce4e-3dee-473b-8094-550b3a8b2430', 'type': 'telemetry_profile', 'uuid': '7ae2af27-0e43-4665-8f2d-b88f24108be5'} 02/10/2025 00:47:52.714 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-359e696f-54d8-4ec3-ad2b-75acb9084e99', 'type': 'device_functional_group', 'uuid': 'fa1ce1b7-37ed-498b-9e38-fc6774c5276d'} 02/10/2025 00:47:52.785 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-26dc5035-b27b-4d3c-b140-ca89fabe7cc0', 'type': 'device_functional_group', 'uuid': '012ad82f-c7ba-4796-9b07-4ac9d8404469'} 02/10/2025 00:47:52.855 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-dca27c0b-10b2-4e7b-a8ec-daeb67cbfa00', 'type': 'device_functional_group', 'uuid': 'dd78031c-0a8c-4a4d-833f-39cbd73d4e0e'} 02/10/2025 00:47:52.927 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-12a9e388-172a-4364-9700-0500e75bfff7', 'type': 'device_functional_group', 'uuid': 'd41d682e-e80f-4a99-b2cd-c4ac483b4ea2'} 02/10/2025 00:47:52.998 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-f633172c-7acd-4bb4-9841-5627581a65d4', 'type': 'device_functional_group', 'uuid': 'eccf0edb-1adb-4362-b473-2e597267d2d4'} 02/10/2025 00:47:53.070 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-fabde995-9d5f-4f6b-af22-52a04ab99c0e', 'type': 'device_functional_group', 'uuid': 'fd302250-fbd4-4aea-972d-996c428d4e90'} 02/10/2025 00:47:53.148 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-a54322d8-79b3-4b31-a86b-bf10914d2f24', 'type': 'device_functional_group', 'uuid': '7cd811c8-efce-4d1a-bd13-20cc9ef1c6af'} 02/10/2025 00:47:53.224 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-7fa77d5a-0fb3-4ec2-9c0d-772b99f921b0', 'type': 'device_functional_group', 'uuid': 'bb6830e2-8c07-4496-9f50-936aed91f40b'} 02/10/2025 00:47:53.291 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-eaaa048f-3843-4177-b657-4dc390706413', 'type': 'device_functional_group', 'uuid': '1afb6513-5dc6-4ac2-8407-b5c8e84fedaa'} 02/10/2025 00:47:53.357 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-3fedd164-d66e-4ef6-a4f9-7d2c8efddf90', 'type': 'device_functional_group', 'uuid': '2c7ec997-dff9-4277-a899-7a2f5de54a72'} 02/10/2025 00:47:53.438 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_ipam_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'id_perms': {'created': '2025-02-10T00:47:53.432826', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:53.432826', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12323418761445298220, 'uuid_mslong': 1689718915266006509}}, 'ipam_subnet_method': 'user-defined-subnet', 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '17731666-a2b0-4ded-ab05-94123e54d02c'}, 'oper': 'CREATE', 'request-id': 'req-b02cd4b5-ff19-4e62-b142-6361d0a1fd67', 'type': 'network_ipam', 'uuid': '17731666-a2b0-4ded-ab05-94123e54d02c'} 02/10/2025 00:47:53.451 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_network identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local url = http://10.0.0.17:8082/virtual-networks operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-device-manager remote_ip = 10.0.0.12 body = {"virtual-network": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local"], "parent_type": "project", "address_allocation_mode": "user-defined-subnet-only", "network_ipam_refs": [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": null, "subnet_uuid": "a930d7f0-e748-11ef-ade5-fa163e04c3da", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "17731666-a2b0-4ded-ab05-94123e54d02c"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:47:53.545 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'obj_dict': {'address_allocation_mode': 'user-defined-subnet-only', 'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-02-10T00:47:53.499952', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:53.499952', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12861744850383878866, 'uuid_mslong': 10959227621228496113}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'addr_from_start': True, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': 'fe80::1', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': 'fe80::2', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': 'fe80::', 'ip_prefix_len': 64}, 'subnet_name': None, 'subnet_uuid': 'a930d7f0-e748-11ef-ade5-fa163e04c3da', 'subscriber_tag': None, 'vlan_tag': None}]}, 'to': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'uuid': '17731666-a2b0-4ded-ab05-94123e54d02c'}], 'parent_type': 'project', 'parent_uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9816ff74-fff9-44f1-b27e-18cc06d73ad2', 'virtual_network_network_id': 5}, 'oper': 'CREATE', 'request-id': 'req-a91dc3bc-f8a3-42ad-962a-8908502de880', 'type': 'virtual_network', 'uuid': '9816ff74-fff9-44f1-b27e-18cc06d73ad2'} 02/10/2025 00:47:53.546 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 02/10/2025 00:47:53.546 7fe2420e9d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:53.547 7fe2420e9d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:_internal_vn_ipv6_link_local elements = { address_allocation_mode : "user-defined-subnet-only"display_name : "_internal_vn_ipv6_link_local"fq_name : ["default-domain", "default-project", "_internal_vn_ipv6_link_local"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10959227621228496113, "uuid_lslong": 12861744850383878866}, "enable": true, "created": "2025-02-10T00:47:53.499952", "last_modified": "2025-02-10T00:47:53.499952", "description": null, "user_visible": true, "creator": null}is_shared : falsenetwork_ipam_refs : [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": "fe80::2", "subnet_uuid": "a930d7f0-e748-11ef-ade5-fa163e04c3da", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "17731666-a2b0-4ded-ab05-94123e54d02c"}]parent_type : "project"parent_uuid : "39a719a6-69b7-4d13-b619-34be5eda63c7"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9816ff74-fff9-44f1-b27e-18cc06d73ad2"virtual_network_network_id : 5 } deleted = False >> 02/10/2025 00:47:53.547 7fe2420e9d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:53.564 7fe2411ffeb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = http://127.0.0.1/routing-instances operation = post body = {"routing-instance": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local", "_internal_vn_ipv6_link_local"], "parent_type": "virtual-network", "routing_instance_is_default": true, "routing_instance_has_pnf": false, "routing_instance_fabric_snat": false, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain >> 02/10/2025 00:47:53.629 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-02-10T00:47:53.612077', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:53.612077', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12995121560485866180, 'uuid_mslong': 11117574918767070981}}, 'parent_type': 'virtual-network', 'parent_uuid': '9816ff74-fff9-44f1-b27e-18cc06d73ad2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '9a498f7c-34e7-4f05-b457-f23549c7aac4'}, 'oper': 'CREATE', 'request-id': 'req-a91dc3bc-f8a3-42ad-962a-8908502de880', 'type': 'routing_instance', 'uuid': '9a498f7c-34e7-4f05-b457-f23549c7aac4'} 02/10/2025 00:47:53.673 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2025-02-10T00:47:53.663743', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:47:53.663743', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10055242017731735391, 'uuid_mslong': 581292663398810624}}, 'perms2': {'global_access': 0, 'owner': 'b81cc19dda964068a46142918d560c5c', 'owner_access': 7, 'share': []}, 'uuid': '08112a98-f86d-4400-8b8b-6557157b6f5f'}, 'oper': 'CREATE', 'request-id': 'req-a68ab1c7-2e13-420f-8350-f29509774d5c', 'type': 'route_target', 'uuid': '08112a98-f86d-4400-8b8b-6557157b6f5f'} 02/10/2025 00:47:53.709 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-d3a50f21-7799-4d90-9d3d-6b58db58a574', 'type': 'routing_instance', 'uuid': '9a498f7c-34e7-4f05-b457-f23549c7aac4'} 02/10/2025 00:47:56.429 7fe2411e4a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:47:56.430 7fe2411e4a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:47:56.431 7fe2411e4a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:56.432 7fe2411e4a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:47:56.432 7fe2411e4a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:56.432 7fe2411e4a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:47:56.432 7fe2411e4a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:47:56.432 7fe2411e4a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:00.431 7fe2408eaac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:00.432 7fe2408eaac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:00.432 7fe2408eaac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:00.432 7fe2408eaac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:00.433 7fe2408eaac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:00.434 7fe2408eaac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:00.434 7fe2408eaac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:04.434 7fe241283c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:04.435 7fe241283c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:04.436 7fe241283c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:08.435 7fe2411ffcc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:08.436 7fe2411ffcc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:08.437 7fe2411ffcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:08.438 7fe2411ffcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:08.438 7fe2411ffcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:12.437 7fe240946f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:12.438 7fe240946f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:12.438 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:12.438 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:12.438 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:12.439 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:16.439 7fe240946f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:16.441 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:16.442 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:20.442 7fe240946f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:20.443 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:20.444 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:20.444 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:20.444 7fe240946f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:20.444 7fe240946f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:20.444 7fe240946f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:24.444 7fe24086d630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:24.445 7fe24086d630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:24.446 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:24.447 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:24.447 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:28.447 7fe24086d630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:28.448 7fe24086d630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:28.448 7fe24086d630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:28.448 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:28.448 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:28.449 7fe24086d630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.333 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-1 url = http://10.0.0.17:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.17 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-1"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.342 7fe24076b438 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-3 url = http://10.0.0.17:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.8", "address": "10.20.0.8", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-3"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.395 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-3'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.8', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.8', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-3'], 'id_perms': {'created': '2025-02-10T00:48:32.375094', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:48:32.375094', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9594636931658856801, 'uuid_mslong': 13921461055092968836}}, 'parent_type': 'routing-instance', 'parent_uuid': '45194e4d-40cd-4d66-b566-0e6a344a5099', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c132f712-0f40-4d84-8526-ff746c5eb961'}, 'oper': 'CREATE', 'request-id': 'req-5da0ef16-7b95-4675-bbe1-d44b34ab4dc3', 'type': 'bgp_router', 'uuid': 'c132f712-0f40-4d84-8526-ff746c5eb961'} 02/10/2025 00:48:32.395 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:48:32.396 7fe24210cf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.396 7fe24210cf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.8", "address": "10.20.0.8", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13921461055092968836, "uuid_lslong": 9594636931658856801}, "enable": true, "created": "2025-02-10T00:48:32.375094", "last_modified": "2025-02-10T00:48:32.375094", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c132f712-0f40-4d84-8526-ff746c5eb961" } deleted = False >> 02/10/2025 00:48:32.404 7fe24210cf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.417 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.11', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.11', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-1'], 'id_perms': {'created': '2025-02-10T00:48:32.385515', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:48:32.385515', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12233438452251239835, 'uuid_mslong': 3347274847704074125}}, 'parent_type': 'routing-instance', 'parent_uuid': '45194e4d-40cd-4d66-b566-0e6a344a5099', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e73e8bd-4700-478d-a9c5-e774f00a259b'}, 'oper': 'CREATE', 'request-id': 'req-d5017dcf-f7ea-4099-964c-66fcefd6c758', 'type': 'bgp_router', 'uuid': '2e73e8bd-4700-478d-a9c5-e774f00a259b'} 02/10/2025 00:48:32.417 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:48:32.418 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.418 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2705-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3347274847704074125, "uuid_lslong": 12233438452251239835}, "enable": true, "created": "2025-02-10T00:48:32.385515", "last_modified": "2025-02-10T00:48:32.385515", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2e73e8bd-4700-478d-a9c5-e774f00a259b" } deleted = False >> 02/10/2025 00:48:32.418 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.422 7fe24082a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-2 url = http://10.0.0.17:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-2"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.449 7fe2411d0ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:32.450 7fe2411d0ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:32.451 7fe2411d0ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.535 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-2'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.6', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.6', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-2'], 'id_perms': {'created': '2025-02-10T00:48:32.527080', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:48:32.527080', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10488367235114703136, 'uuid_mslong': 11154934064457402945}}, 'parent_type': 'routing-instance', 'parent_uuid': '45194e4d-40cd-4d66-b566-0e6a344a5099', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9ace496e-24e3-4a41-918e-2a6e3adb9920'}, 'oper': 'CREATE', 'request-id': 'req-311c7705-061a-44b6-9ffb-b53848f08103', 'type': 'bgp_router', 'uuid': '9ace496e-24e3-4a41-918e-2a6e3adb9920'} 02/10/2025 00:48:32.536 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:48:32.536 7fe2411db630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.536 7fe2411db630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11154934064457402945, "uuid_lslong": 10488367235114703136}, "enable": true, "created": "2025-02-10T00:48:32.527080", "last_modified": "2025-02-10T00:48:32.527080", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9ace496e-24e3-4a41-918e-2a6e3adb9920" } deleted = False >> 02/10/2025 00:48:32.536 7fe2411db630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:32.550 7fe24076b438 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-uuid": "c132f712-0f40-4d84-8526-ff746c5eb961"} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.599 7fe24076b438 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-type": "bgp-router", "ref-uuid": "c132f712-0f40-4d84-8526-ff746c5eb961", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.621 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.17 body = {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b"} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.633 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-1bc99b60-4a82-4809-89a2-6d54e4724641', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:48:32.669 7fe24086d630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.17 body = {"type": "global-system-config", "uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-type": "bgp-router", "ref-uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.705 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-dfa02d0f-ff08-4005-963c-a641653eb437', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:48:32.724 7fe24082a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-uuid": "9ace496e-24e3-4a41-918e-2a6e3adb9920"} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.777 7fe24082a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ref-type": "bgp-router", "ref-uuid": "9ace496e-24e3-4a41-918e-2a6e3adb9920", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:32.798 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-1f96b610-4739-4168-912f-509fe4497f10', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:48:33.005 7fe2411e1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2e73e8bd-4700-478d-a9c5-e774f00a259b object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-1 url = http://10.0.0.17:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"type": "bgp-router", "uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b", "ref-type": "bgp-router", "ref-uuid": null, "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "operation": "ADD", "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}} domain = default-domain project = admin user = admin >> 02/10/2025 00:48:33.040 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-1'], 'oper': 'UPDATE', 'request-id': 'req-15c98cf5-6acf-43d1-bcca-2ab0301267f6', 'type': 'bgp_router', 'uuid': '2e73e8bd-4700-478d-a9c5-e774f00a259b'} 02/10/2025 00:48:33.058 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-15c98cf5-6acf-43d1-bcca-2ab0301267f6', 'type': 'bgp_router', 'uuid': 'c132f712-0f40-4d84-8526-ff746c5eb961'} 02/10/2025 00:48:33.059 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.059 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "c132f712-0f40-4d84-8526-ff746c5eb961"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3347274847704074125, "uuid_lslong": 12233438452251239835}, "enable": true, "created": "2025-02-10T00:48:32.385515", "last_modified": "2025-02-10T00:48:33.032792", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2e73e8bd-4700-478d-a9c5-e774f00a259b" } deleted = False >> 02/10/2025 00:48:33.059 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.066 7fe240869eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.066 7fe240869eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.8", "address": "10.20.0.8", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13921461055092968836, "uuid_lslong": 9594636931658856801}, "enable": true, "created": "2025-02-10T00:48:32.375094", "last_modified": "2025-02-10T00:48:33.030721", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c132f712-0f40-4d84-8526-ff746c5eb961" } deleted = False >> 02/10/2025 00:48:33.067 7fe240869eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.109 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-2'], 'oper': 'UPDATE', 'request-id': 'req-a8731977-9cd3-47e1-b8c5-ab3c83e46da4', 'type': 'bgp_router', 'uuid': '9ace496e-24e3-4a41-918e-2a6e3adb9920'} 02/10/2025 00:48:33.117 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-a8731977-9cd3-47e1-b8c5-ab3c83e46da4', 'type': 'bgp_router', 'uuid': 'c132f712-0f40-4d84-8526-ff746c5eb961'} 02/10/2025 00:48:33.117 7fe2409c3240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.117 7fe2409c3240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "c132f712-0f40-4d84-8526-ff746c5eb961"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11154934064457402945, "uuid_lslong": 10488367235114703136}, "enable": true, "created": "2025-02-10T00:48:32.527080", "last_modified": "2025-02-10T00:48:33.089414", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9ace496e-24e3-4a41-918e-2a6e3adb9920" } deleted = False >> 02/10/2025 00:48:33.117 7fe2409c3240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.121 7fe24082a828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.121 7fe24082a828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.8", "address": "10.20.0.8", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "9ace496e-24e3-4a41-918e-2a6e3adb9920"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13921461055092968836, "uuid_lslong": 9594636931658856801}, "enable": true, "created": "2025-02-10T00:48:32.375094", "last_modified": "2025-02-10T00:48:33.087978", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c132f712-0f40-4d84-8526-ff746c5eb961" } deleted = False >> 02/10/2025 00:48:33.121 7fe24082a828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.128 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-2'], 'oper': 'UPDATE', 'request-id': 'req-8fb96c37-51b3-4636-aed0-37b8cc1bd104', 'type': 'bgp_router', 'uuid': '9ace496e-24e3-4a41-918e-2a6e3adb9920'} 02/10/2025 00:48:33.130 7fe240869eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.131 7fe240869eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "2e73e8bd-4700-478d-a9c5-e774f00a259b"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "c132f712-0f40-4d84-8526-ff746c5eb961"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11154934064457402945, "uuid_lslong": 10488367235114703136}, "enable": true, "created": "2025-02-10T00:48:32.527080", "last_modified": "2025-02-10T00:48:33.121311", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9ace496e-24e3-4a41-918e-2a6e3adb9920" } deleted = False >> 02/10/2025 00:48:33.131 7fe240869eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.140 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-1'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-8fb96c37-51b3-4636-aed0-37b8cc1bd104', 'type': 'bgp_router', 'uuid': '2e73e8bd-4700-478d-a9c5-e774f00a259b'} 02/10/2025 00:48:33.148 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:33.148 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.11", "address": "10.20.0.11", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "9ace496e-24e3-4a41-918e-2a6e3adb9920"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "c132f712-0f40-4d84-8526-ff746c5eb961"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2705-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2705-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3347274847704074125, "uuid_lslong": 12233438452251239835}, "enable": true, "created": "2025-02-10T00:48:32.385515", "last_modified": "2025-02-10T00:48:33.119742", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "45194e4d-40cd-4d66-b566-0e6a344a5099"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2e73e8bd-4700-478d-a9c5-e774f00a259b" } deleted = False >> 02/10/2025 00:48:33.148 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:36.450 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:36.452 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:36.453 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:40.453 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:40.454 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:40.454 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:40.454 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:40.454 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:40.455 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:44.455 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:44.456 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:44.457 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:44.458 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:44.458 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:44.458 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:48.458 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:48.459 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:48.460 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:52.461 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:52.462 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:52.463 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:56.462 7fe240823e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:48:56.464 7fe240823e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:48:56.465 7fe240823e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:00.465 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:00.466 7fe2433beac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:00.467 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:00.468 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:00.468 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:00.468 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:04.467 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:04.469 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:04.470 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:08.469 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:08.471 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:08.472 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:08.472 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:08.472 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:08.472 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:08.472 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:12.471 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:12.475 7fe2433beac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:12.476 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:12.477 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:12.477 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:16.476 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:16.477 7fe2433beac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:16.478 7fe2433beac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:16.479 7fe2433beac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:16.479 7fe2433beac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:20.479 7fe241f55240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:20.480 7fe241f55240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:20.481 7fe241f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:24.481 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:24.482 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:24.483 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:24.484 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:24.484 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:24.484 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.142 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-2. url = http://10.0.0.17:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-2."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:49:28.161 7fe2408a8b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-3. url = http://10.0.0.17:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-3."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:49:28.208 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'id_perms': {'created': '2025-02-10T00:49:28.198755', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:49:28.198755', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13058866571177989544, 'uuid_mslong': 10685094707158598527}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '94491506-2b98-437f-b53a-69f5284995a8'}, 'oper': 'CREATE', 'request-id': 'req-fa619134-94df-4256-bd01-e54e44742d74', 'type': 'database_node', 'uuid': '94491506-2b98-437f-b53a-69f5284995a8'} 02/10/2025 00:49:28.209 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:49:28.210 7fe24074ff60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.210 7fe24074ff60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2. elements = { database_node_ip_address : "10.0.0.12"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10685094707158598527, "uuid_lslong": 13058866571177989544}, "enable": true, "created": "2025-02-10T00:49:28.198755", "last_modified": "2025-02-10T00:49:28.198755", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "94491506-2b98-437f-b53a-69f5284995a8" } deleted = False >> 02/10/2025 00:49:28.210 7fe24074ff60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.237 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'id_perms': {'created': '2025-02-10T00:49:28.216130', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:49:28.216130', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13055058212476642416, 'uuid_mslong': 14692864062812340841}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cbe78a04-dd08-4269-b52c-e2468cb76470'}, 'oper': 'CREATE', 'request-id': 'req-bea67407-3133-4606-8ae9-ec605497cfdf', 'type': 'database_node', 'uuid': 'cbe78a04-dd08-4269-b52c-e2468cb76470'} 02/10/2025 00:49:28.238 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:49:28.239 7fe2411e26d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.239 7fe2411e26d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3. elements = { database_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14692864062812340841, "uuid_lslong": 13055058212476642416}, "enable": true, "created": "2025-02-10T00:49:28.216130", "last_modified": "2025-02-10T00:49:28.216130", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "cbe78a04-dd08-4269-b52c-e2468cb76470" } deleted = False >> 02/10/2025 00:49:28.239 7fe2411e26d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.267 7fe240824390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-1. url = http://10.0.0.17:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.17 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.17", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-1."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:49:28.313 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.17', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'id_perms': {'created': '2025-02-10T00:49:28.300039', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:49:28.300039', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13337254702860769403, 'uuid_mslong': 11033830939195166002}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '99200ac7-8a71-4d32-b917-727d0aec987b'}, 'oper': 'CREATE', 'request-id': 'req-159c40a5-bac9-4f95-abbd-63f7091fa41b', 'type': 'database_node', 'uuid': '99200ac7-8a71-4d32-b917-727d0aec987b'} 02/10/2025 00:49:28.315 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:49:28.315 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.316 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. elements = { database_node_ip_address : "10.0.0.17"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11033830939195166002, "uuid_lslong": 13337254702860769403}, "enable": true, "created": "2025-02-10T00:49:28.300039", "last_modified": "2025-02-10T00:49:28.300039", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "99200ac7-8a71-4d32-b917-727d0aec987b" } deleted = False >> 02/10/2025 00:49:28.316 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.483 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:28.484 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:28.485 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.486 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:28.486 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:28.486 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:32.486 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:32.487 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:32.487 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:32.487 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:32.488 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:36.488 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:36.490 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:36.491 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:40.490 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:40.491 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:40.491 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:40.491 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:40.492 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:44.492 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:44.493 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:44.493 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:44.494 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:44.495 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:48.494 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:48.496 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:48.497 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:52.496 7fe24076e978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:52.498 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:52.499 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:52.499 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:52.499 7fe24076e978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:52.499 7fe24076e978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:52.499 7fe24076e978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:56.499 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:49:56.500 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:49:56.501 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:00.501 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:50:00.503 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:00.504 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:50:00.504 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:00.504 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:00.504 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:50:00.504 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:04.503 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:50:04.504 7fe2420c0390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:50:04.504 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:50:04.504 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:04.504 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:50:04.504 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:50:04.505 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:08.505 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:50:08.506 7fe2420c0390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:08.507 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:08.508 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:50:08.508 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:12.508 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:12.509 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739148436412283 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.17:8086, 10.0.0.30:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 00:50:12.510 7fe2420c0390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:15.899 7fe2420c0390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-2. url = http://10.0.0.17:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-2."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:15.951 7fe240782a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-3. url = http://10.0.0.17:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-3."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:15.979 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'id_perms': {'created': '2025-02-10T00:50:15.944895', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:15.944895', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10207530208053698800, 'uuid_mslong': 7506592660373979892}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '682cc640-c325-42f4-8da8-6ea4751c20f0'}, 'oper': 'CREATE', 'request-id': 'req-c63dfe87-976f-4de5-b7a4-4ce34adb857b', 'type': 'analytics_node', 'uuid': '682cc640-c325-42f4-8da8-6ea4751c20f0'} 02/10/2025 00:50:15.979 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:15.980 7fe24070ef60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:15.980 7fe24070ef60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-2. elements = { analytics_node_ip_address : "10.0.0.12"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7506592660373979892, "uuid_lslong": 10207530208053698800}, "enable": true, "created": "2025-02-10T00:50:15.944895", "last_modified": "2025-02-10T00:50:15.944895", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "682cc640-c325-42f4-8da8-6ea4751c20f0" } deleted = False >> 02/10/2025 00:50:15.980 7fe24070ef60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:16.054 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'id_perms': {'created': '2025-02-10T00:50:16.021849', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:16.021849', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12805948032707213614, 'uuid_mslong': 10276488160761695306}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e9d6b88-f8b5-4c4a-b1b7-dde30da0392e'}, 'oper': 'CREATE', 'request-id': 'req-c9c3d106-fd70-4430-a2ce-1662a5312b9c', 'type': 'analytics_node', 'uuid': '8e9d6b88-f8b5-4c4a-b1b7-dde30da0392e'} 02/10/2025 00:50:16.055 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:16.055 7fe2407a52e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:16.058 7fe2407a52e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-3. elements = { analytics_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10276488160761695306, "uuid_lslong": 12805948032707213614}, "enable": true, "created": "2025-02-10T00:50:16.021849", "last_modified": "2025-02-10T00:50:16.021849", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "8e9d6b88-f8b5-4c4a-b1b7-dde30da0392e" } deleted = False >> 02/10/2025 00:50:16.058 7fe2407a52e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:16.077 7fe24079e828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-1. url = http://10.0.0.17:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.17 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.17", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-1."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:16.158 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.17', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'id_perms': {'created': '2025-02-10T00:50:16.150083', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:16.150083', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9392724047808559760, 'uuid_mslong': 8162967698480254056}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7148afdf-5ce7-4c68-8259-a8c1b6e5fa90'}, 'oper': 'CREATE', 'request-id': 'req-f6044a93-7852-448d-9be2-855282366db2', 'type': 'analytics_node', 'uuid': '7148afdf-5ce7-4c68-8259-a8c1b6e5fa90'} 02/10/2025 00:50:16.158 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:16.159 7fe240734240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:16.159 7fe240734240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. elements = { analytics_node_ip_address : "10.0.0.17"display_name : "cn-jenkins-deploy-platform-ansible-os-2705-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 8162967698480254056, "uuid_lslong": 9392724047808559760}, "enable": true, "created": "2025-02-10T00:50:16.150083", "last_modified": "2025-02-10T00:50:16.150083", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "3915a02a-6698-481d-91c4-4ed56a0071eb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "7148afdf-5ce7-4c68-8259-a8c1b6e5fa90" } deleted = False >> 02/10/2025 00:50:16.159 7fe240734240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 00:50:16.518 7fe24079e828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 00:50:16.519 7fe24079e828 [contrail-api] [INFO]: Session Event: TCP Connected 02/10/2025 00:50:16.519 7fe24079e828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 00:50:16.520 7fe24079e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 00:50:16.521 7fe2407a5978 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:16.521 7fe2407a5978 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:50:27.314 7fe2408beac8 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 02/10/2025 00:50:27.315 7fe2408beac8 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 02/10/2025 00:50:27.315 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.316 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 00:50:27.317 7fe24133be10 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 02/10/2025 00:50:27.317 7fe24133ba20 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:27.321 7fe24133ba20 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:50:27.322 7fe241283c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:27.324 7fe241283c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:50:37.145 7fe240754048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-1. url = http://10.0.0.17:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.17 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.17", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-1."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:37.204 7fe24070e438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-3. url = http://10.0.0.17:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-3."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:37.212 7fe2409a1b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-2. url = http://10.0.0.17:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-2."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:37.231 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.17', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'id_perms': {'created': '2025-02-10T00:50:37.207376', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:37.207376', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12290606046215929148, 'uuid_mslong': 5508033668774054963}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4c707770-5e2b-4c33-aa91-0114a2f7fd3c'}, 'oper': 'CREATE', 'request-id': 'req-f46bd8d7-3d91-424c-bd6f-7669d85c4d04', 'type': 'analytics_alarm_node', 'uuid': '4c707770-5e2b-4c33-aa91-0114a2f7fd3c'} 02/10/2025 00:50:37.232 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:37.284 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'id_perms': {'created': '2025-02-10T00:50:37.268453', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:37.268453', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10986580231559240617, 'uuid_mslong': 18010069354549563272}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f9f09ea8-1213-4f88-9878-2c82de6adba9'}, 'oper': 'CREATE', 'request-id': 'req-67f6ea03-9557-42d0-abc8-9f679ad01d59', 'type': 'analytics_alarm_node', 'uuid': 'f9f09ea8-1213-4f88-9878-2c82de6adba9'} 02/10/2025 00:50:37.285 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:37.326 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'id_perms': {'created': '2025-02-10T00:50:37.310297', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:37.310297', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13617286344178317144, 'uuid_mslong': 16949449896782283925}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eb388ae1-0bfd-4495-bcfa-51c85586b758'}, 'oper': 'CREATE', 'request-id': 'req-fc1f2de6-1820-4005-b30d-ed24b066118a', 'type': 'analytics_alarm_node', 'uuid': 'eb388ae1-0bfd-4495-bcfa-51c85586b758'} 02/10/2025 00:50:37.326 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.426 7fe2408beac8 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001716 02/10/2025 00:50:40.427 7fe2408beac8 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/10/2025 00:50:40.427 7fe2407d7cc0 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 02/10/2025 00:50:40.428 7fe2407d7cc0 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 5 02/10/2025 00:50:40.428 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 02/10/2025 00:50:40.428 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 00:50:40.428 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 00:50:40.428 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:40.430 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 00:50:40.431 7fe2407d7cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 00:50:40.432 7fe250b81d68 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:40.436 7fe250b81d68 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:50:40.437 7fe240766780 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:40.440 7fe240766780 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:50:50.690 7fe24074f390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-2. url = http://10.0.0.17:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-2."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.12", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-2."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:50.711 7fe240877ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-3. url = http://10.0.0.17:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-3."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-3."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:50.718 7fe24086d6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2705-1. url = http://10.0.0.17:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.17 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2705-1."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.17", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2705-1."}} domain = default-domain project = admin user = admin >> 02/10/2025 00:50:50.760 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.12', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-2.'], 'id_perms': {'created': '2025-02-10T00:50:50.737419', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:50.737419', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12752449499354008418, 'uuid_mslong': 7895454153088387570}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6d9249b8-6737-49f2-b0f9-cd41191a8b62'}, 'oper': 'CREATE', 'request-id': 'req-dda76257-dd1c-4ef8-b6ef-338265899093', 'type': 'analytics_snmp_node', 'uuid': '6d9249b8-6737-49f2-b0f9-cd41191a8b62'} 02/10/2025 00:50:50.761 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 00:50:50.791 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-3.'], 'id_perms': {'created': '2025-02-10T00:50:50.771364', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:50.771364', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11813134000567727316, 'uuid_mslong': 1391068680495973857}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '134e1198-3f22-45e1-a3f0-aec8ebedb4d4'}, 'oper': 'CREATE', 'request-id': 'req-a48d5669-5b8b-43aa-9cff-5fd0392c1ca4', 'type': 'analytics_snmp_node', 'uuid': '134e1198-3f22-45e1-a3f0-aec8ebedb4d4'} 02/10/2025 00:50:50.791 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 00:50:50.795 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.17', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2705-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2705-1.'], 'id_perms': {'created': '2025-02-10T00:50:50.772526', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:50:50.772526', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12952750622117796846, 'uuid_mslong': 17263210591584470522}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ef933e91-9227-45fa-b3c1-6a106f8d1bee'}, 'oper': 'CREATE', 'request-id': 'req-b2757be1-9da1-4ecc-b43f-fec6e7b8962a', 'type': 'analytics_snmp_node', 'uuid': 'ef933e91-9227-45fa-b3c1-6a106f8d1bee'} 02/10/2025 00:50:50.796 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 00:50:50.797 7fe240761eb8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 00:50:50.798 7fe240761eb8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 00:52:47.223 7fe2411d0ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.231 7fe24081dac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.248 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-bb88ab5a-c465-46e2-971c-a825f6cb34a2', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:52:47.259 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-3f3ee110-ab2c-4862-bf70-553bceebbd0f', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 00:52:47.341 7fe240631e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-2 url = http://10.0.0.17:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2705-2"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.7", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2705-2"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.361 7fe2412018d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-1 url = http://10.0.0.17:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2705-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.21", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2705-1"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.377 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2705-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2'], 'id_perms': {'created': '2025-02-10T00:52:47.365126', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:52:47.365126', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13435032489608240652, 'uuid_mslong': 5573792837932631608}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4d5a170e-0c97-4638-ba72-d2de10ee5e0c', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.7'}, 'oper': 'CREATE', 'request-id': 'req-47bf54fa-0b91-4c96-ac58-9b5f8417ed68', 'type': 'virtual_router', 'uuid': '4d5a170e-0c97-4638-ba72-d2de10ee5e0c'} 02/10/2025 00:52:47.378 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 02/10/2025 00:52:47.427 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2705-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1'], 'id_perms': {'created': '2025-02-10T00:52:47.416984', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:52:47.416984', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10379775603635547225, 'uuid_mslong': 1088782508011048307}}, 'parent_type': 'global-system-config', 'parent_uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0f1c21ec-23a8-4d73-900c-5eeac6f66c59', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.21'}, 'oper': 'CREATE', 'request-id': 'req-6b59bd51-8de5-46ab-b45c-a681e341934f', 'type': 'virtual_router', 'uuid': '0f1c21ec-23a8-4d73-900c-5eeac6f66c59'} 02/10/2025 00:52:47.427 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 02/10/2025 00:52:47.679 7fe24097b6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-2:vhost0 url = http://10.0.0.17:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2705-2", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "f712f046-052f-4c93-8af7-f43ecfc046ae"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.714 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2', 'vhost0'], 'id_perms': {'created': '2025-02-10T00:52:47.697439', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:52:47.697439', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13437070010327430451, 'uuid_mslong': 1910545552426615640}}, 'parent_type': 'virtual-router', 'parent_uuid': '4d5a170e-0c97-4638-ba72-d2de10ee5e0c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1a839f0e-b397-4358-ba7a-0ffb539ef533', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:1a:83:9f:0e:b3']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'f712f046-052f-4c93-8af7-f43ecfc046ae'}]}, 'oper': 'CREATE', 'request-id': 'req-e1413f8d-979a-49d3-a893-acb03d24905b', 'type': 'virtual_machine_interface', 'uuid': '1a839f0e-b397-4358-ba7a-0ffb539ef533'} 02/10/2025 00:52:47.715 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 02/10/2025 00:52:47.728 7fe240630630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a839f0e-b397-4358-ba7a-0ffb539ef533 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-2:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 02/10/2025 00:52:47.733 7fe242003048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-1:vhost0 url = http://10.0.0.17:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2705-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "f712f046-052f-4c93-8af7-f43ecfc046ae"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:47.757 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e1413f8d-979a-49d3-a893-acb03d24905b', 'type': 'virtual_machine_interface', 'uuid': '1a839f0e-b397-4358-ba7a-0ffb539ef533'} 02/10/2025 00:52:47.791 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1', 'vhost0'], 'id_perms': {'created': '2025-02-10T00:52:47.774313', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-10T00:52:47.774313', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13236554767037521891, 'uuid_mslong': 2629409757902620031}}, 'parent_type': 'virtual-router', 'parent_uuid': '0f1c21ec-23a8-4d73-900c-5eeac6f66c59', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '247d8a3e-5cbb-457f-b7b1-b06e2b465fe3', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:24:7d:8a:3e:5c']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'f712f046-052f-4c93-8af7-f43ecfc046ae'}]}, 'oper': 'CREATE', 'request-id': 'req-52c72a18-aeac-4eac-a280-615cdd74ccfe', 'type': 'virtual_machine_interface', 'uuid': '247d8a3e-5cbb-457f-b7b1-b06e2b465fe3'} 02/10/2025 00:52:47.792 7fe241679780 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 02/10/2025 00:52:47.805 7fe2406c9048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 247d8a3e-5cbb-457f-b7b1-b06e2b465fe3 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 02/10/2025 00:52:47.823 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-52c72a18-aeac-4eac-a280-615cdd74ccfe', 'type': 'virtual_machine_interface', 'uuid': '247d8a3e-5cbb-457f-b7b1-b06e2b465fe3'} 02/10/2025 00:52:48.258 7fe24096d828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 93bd8fdc-1098-4284-8f0a-ab40458fa26a object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = http://10.0.0.17:8082/access-control-list/93bd8fdc-1098-4284-8f0a-ab40458fa26a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/usr/bin/contrail-schema remote_ip = 10.0.0.12 body = {"access-control-list": {"uuid": "93bd8fdc-1098-4284-8f0a-ab40458fa26a", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -8954502187313798800}} domain = default-domain project = admin user = admin >> 02/10/2025 00:52:48.273 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-9d141f0b-653a-4c66-ad90-5bf3c43c5b33', 'type': 'access_control_list', 'uuid': '93bd8fdc-1098-4284-8f0a-ab40458fa26a'} 02/10/2025 00:53:13.548 7fe24062d240 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 00:53:13.552 7fe242cc8b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 00:53:46.357 7fe2408abc18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 00:53:46.361 7fe2408abc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 01:47:26.385 7fe2468d0978 [contrail-api] [ERROR]: Failed to resync: Unable to establish connection to http://10.0.0.17:5000/v3/domains? 02/10/2025 01:56:00.201 7fe2408beac8 [contrail-api] [ERROR]: Session Event: TCP Connection Closed 02/10/2025 01:56:00.201 7fe24070eeb8 [contrail-api] [INFO]: Processing event[EvTcpClose] in state[Established] 02/10/2025 01:56:00.202 7fe24070eeb8 [contrail-api] [INFO]: Session Event: TCP Connected 02/10/2025 01:56:00.202 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 02/10/2025 01:56:00.202 7fe24070eeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.17:5673, 10.0.0.12:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.17:5000/v3, ] status = Up description = >>, ] description = Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying], Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 01:56:00.203 7fe24070eeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 01:56:00.203 7fe24208fac8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 01:56:00.204 7fe24208fac8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 01:56:00.228 7fe2407cd978 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001017 02/10/2025 01:56:00.228 7fe2407cd978 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 02/10/2025 01:56:00.229 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 01:56:00.230 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.231 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 02/10/2025 01:56:00.232 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVRouter:ContrailConfigTrace] map 02/10/2025 01:56:00.233 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVRouter:ContrailConfigTrace] map 02/10/2025 01:56:00.233 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVMITable:ContrailConfigTrace] map 02/10/2025 01:56:00.233 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVMITable:ContrailConfigTrace] map 02/10/2025 01:56:00.233 7fe24070ec18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 01:56:00.233 7fe24070ec18 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 02/10/2025 01:56:00.234 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 01:56:00.238 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 01:56:00.239 7fe240569240 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 01:56:00.250 7fe240569240 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 01:56:00.251 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 01:56:00.252 7fe24070eeb8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 01:56:04.276 7fe2408ea390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:04.296 7fe2405dab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:04.901 7fe2405c9630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.210 7fe24097beb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.225 7fe2408776d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.281 7fe24054bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.301 7fe24071ca20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.818 7fe2409530f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:05.906 7fe2407160f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.216 7fe240831b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.232 7fe240946780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.286 7fe240785978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.305 7fe2408bef60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.407 7fe24088dd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.421 7fe24053e198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.731 7fe240805780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.746 7fe2409860f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.765 7fe2411e1e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.823 7fe2407bc0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:06.912 7fe2405df978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.221 7fe2409ac240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.239 7fe2405ee8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.291 7fe240520390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.312 7fe2405860f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.330 7fe240902ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.413 7fe24076bcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.427 7fe241283c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.736 7fe2405132e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.752 7fe2407a54e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.769 7fe2405a6438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.828 7fe2407b7198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:07.917 7fe2407cda20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.227 7fe2405c9f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.244 7fe249e70ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.297 7fe240745978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.317 7fe240877d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.336 7fe2408bac18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.419 7fe240575438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.432 7fe240878eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.506 7fe2408a3630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.741 7fe24040c2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.758 7fe2405f58d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.775 7fe2405da2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.833 7fe2405816d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:08.927 7fe24055beb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.232 7fe2405c6048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.250 7fe24052cf60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.322 7fe24059af60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.325 7fe2405776d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.345 7fe240583198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.425 7fe24041dcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.438 7fe240440d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.517 7fe240448eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.673 7fe2403ced68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.687 7fe2403d88d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.721 7fe240436438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.746 7fe2403e24e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.764 7fe2403ea588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.781 7fe2403ccc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.838 7fe2403f4198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:09.932 7fe2403fc240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.238 7fe240403390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.261 7fe24038a438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.343 7fe2403924e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.346 7fe24039a588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.354 7fe24039a630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.441 7fe2403a66d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.446 7fe2403af780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.522 7fe2403b6828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.679 7fe2403bf8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.693 7fe2403c8978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.727 7fe240350a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.752 7fe240350ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.770 7fe24035bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.786 7fe240364cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.843 7fe24036bd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:10.937 7fe240374e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.243 7fe24037aeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.271 7fe2403640f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.349 7fe240384ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.351 7fe24030fb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.359 7fe240315cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.445 7fe240317d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.450 7fe240327e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.527 7fe24032eeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.684 7fe240315438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.698 7fe240338ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.733 7fe240344b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.758 7fe2402cbc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.776 7fe2402d3cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.790 7fe2402ddd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.848 7fe2402e5e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:11.952 7fe2402e5198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.249 7fe2402e5240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.279 7fe240364d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.353 7fe24035b048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.356 7fe24034cd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.364 7fe2403c3240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.451 7fe2403bb438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.455 7fe2403b3630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.532 7fe2403c84e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.689 7fe24039ae10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.703 7fe2404082e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.738 7fe2403f82e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.762 7fe2403de828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.781 7fe2405834e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.795 7fe24053ad68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.853 7fe24053a390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:12.957 7fe24058f780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.254 7fe2405b0438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.286 7fe2405956d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.359 7fe2405d7a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.362 7fe240581438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.371 7fe2405da828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.455 7fe2405da780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.461 7fe24070ecc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.557 7fe24040cc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.694 7fe240513ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.708 7fe240793a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.743 7fe240645e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.767 7fe240958438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.786 7fe2407454e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.800 7fe240936198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.861 7fe240560630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:13.962 7fe2405b90f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.259 7fe240567780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.292 7fe24208fcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.364 7fe2405dff60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.367 7fe2420a76d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.375 7fe24200aac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.461 7fe240824ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.466 7fe2405df198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.562 7fe240586630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.699 7fe240538630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.714 7fe2405202e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.748 7fe2405eed68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.773 7fe2402ece10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.793 7fe2405dce10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.805 7fe24038da20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.866 7fe24041cac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:14.967 7fe240448b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.264 7fe2402f0e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.298 7fe2402ce390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.369 7fe240438048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.372 7fe24043d0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.380 7fe2403e90f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.467 7fe240403630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.471 7fe2403eb4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.567 7fe2402f3390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.703 7fe2402fc438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.721 7fe2403064e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.753 7fe24028e588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.778 7fe240296630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.798 7fe24029f6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.810 7fe2403038d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.872 7fe2402ab2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:15.972 7fe2402b0390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.270 7fe2402bd978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.304 7fe2402c4a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.374 7fe24024cac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.381 7fe2402bd438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.385 7fe240255c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.472 7fe240265240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.476 7fe24026d2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.573 7fe240274390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.710 7fe24027e438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.727 7fe240262588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.763 7fe2403ebc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.792 7fe2404408d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.825 7fe2402f94e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.834 7fe240440588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.877 7fe240805198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:16.979 7fe2408776d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.274 7fe240520b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.309 7fe24053aac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.382 7fe2402c4390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.385 7fe2405e5438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.393 7fe2403d8048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.477 7fe2403f2390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.481 7fe2403f86d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.578 7fe24038f630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.714 7fe24039acc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.732 7fe2403f2e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.768 7fe2411db780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.795 7fe2403b64e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.811 7fe2403c3198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.839 7fe24034c2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.882 7fe240357780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:17.994 7fe240360630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.280 7fe2403eb828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.315 7fe2405d6198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.387 7fe240247d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.393 7fe2401e3e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.399 7fe2401e1eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.482 7fe2401dff60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.486 7fe2401d9048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.584 7fe2401e12e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.719 7fe2401d5c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.738 7fe2401d0cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.773 7fe2401cdd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.800 7fe2401fee10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.816 7fe240201eb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.844 7fe240207f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.887 7fe2401cd390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:18.999 7fe24018cb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.286 7fe240195c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.320 7fe24019acc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.393 7fe2401a0d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.398 7fe2401a7e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.404 7fe2401adeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.490 7fe2401a0198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.493 7fe2401b5ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.589 7fe2401beb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.726 7fe2401c5c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.745 7fe2401c7cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.779 7fe240154d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.806 7fe24015ae10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.825 7fe2401c70f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.849 7fe240162a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:19.894 7fe24016dac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.005 7fe240172b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.291 7fe24017bc18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.327 7fe240182cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.398 7fe240109d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.404 7fe240177f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.409 7fe240111978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.496 7fe24011ba20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.500 7fe240125ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.594 7fe24012db70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.731 7fe240134c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.751 7fe24013bcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.785 7fe240125588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.824 7fe2401438d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.829 7fe2400ce978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.854 7fe2400d5a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:20.899 7fe2400deac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.010 7fe2400e7b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.297 7fe2400eec18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.333 7fe2400daeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.403 7fe2400f7828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.408 7fe2401018d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.413 7fe240108978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.501 7fe240090a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.504 7fe240099ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.599 7fe2400daeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.679 7fe2405df048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:21.715 7fe2405df048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:21.738 7fe233702048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.757 7fe2337080f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.793 7fe233710198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.830 7fe2408ba048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.834 7fe240726f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.859 7fe240134438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:21.904 7fe24012d780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.015 7fe240125828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.303 7fe240118240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.339 7fe240130d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.408 7fe240109438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.413 7fe240172e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.418 7fe24015ae10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.508 7fe2401c7b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.511 7fe2401be240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.604 7fe2401a0780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.744 7fe240172048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.763 7fe2401952e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.798 7fe240338588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.835 7fe2403644e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.838 7fe24035b630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.864 7fe240350c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:22.909 7fe2403c8828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.021 7fe2401e3e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.308 7fe2403bbeb8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.345 7fe2409ac828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.413 7fe2403af780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.417 7fe24038ff60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "routing-instance", "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.422 7fe240408f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.513 7fe2403e62e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.516 7fe24017b2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.609 7fe2403de630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.748 7fe240788198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.768 7fe240292a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_name = url = http://10.0.0.17:8082/fqname-to-id operation = http_post useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.12 body = {"type": "global-system-config", "fq_name": ["default-global-system-config"]} domain = default-domain project = admin user = admin error = None:No connection to zookeeper. >> 02/10/2025 01:56:23.803 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:23.803 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:23.810 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:23.848 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:23.848 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:23.851 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:23.851 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:23.859 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:23.862 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:23.870 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:23.870 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.086 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.086 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.089 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.089 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.118 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.119 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.122 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.139 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.189 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.253 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.255 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.266 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.268 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.323 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.327 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.327 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.337 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.339 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.340 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.353 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.354 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.364 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.365 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.368 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.376 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.381 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.384 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.384 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.420 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.420 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.422 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.422 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.442 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.448 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.448 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.450 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.453 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.460 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.460 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.474 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.477 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.489 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.508 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.516 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.523 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.523 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.524 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.526 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.526 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.536 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.537 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.547 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.577 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.592 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.620 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.620 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.625 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.629 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.632 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.633 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.639 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.640 7fe2330fb0f0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 01:56:24.641 7fe2330fb0f0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 01:56:24.653 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.658 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.662 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.662 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.662 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.715 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.864 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.865 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.866 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:24.867 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:24.875 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.881 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:24.885 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.904 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.909 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.949 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.953 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:24.987 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:24.987 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:24.994 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:25.012 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:25.016 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:25.055 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:25.080 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:25.125 7fe24040be10 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.139 7fe24071ca20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.158 7fe24097beb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.180 7fe24040be10 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.216 7fe24040be10 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.271 7fe24071ca20 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.323 7fe24097beb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.327 7fe24208fac8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.355 7fe240936cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.359 7fe2408ea828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.364 7fe24076b198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.371 7fe24208fac8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.410 7fe24208fac8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.425 7fe2405c1d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.434 7fe24070eeb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.438 7fe2412156d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.449 7fe240936cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.483 7fe240936cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.528 7fe2408ea828 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.561 7fe24076b198 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.579 7fe2405c9630 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.584 7fe24097b6d8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.590 7fe2405c1d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.623 7fe2405c1d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.656 7fe24070eeb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'routing_instance' fq_name = ['default-domain', 'default-project', 'ip-fabric', '__default__'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('routing_instance', ['default-domain', 'default-project', 'ip-fabric', '__default__']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='routing_instance', fq_name=['default-domain', 'default-project', 'ip-fabric', '__default__']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain:default-project:ip-fabric:__default__' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'routing_instance'), **kwargs={'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'routing_instance') kwargs = {'finish': 'default-domain:default-project:ip-fabric:__default__;', 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'routing_instance' columns = None start = 'default-domain:default-project:ip-fabric:__default__:' finish = 'default-domain:default-project:ip-fabric:__default__;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='routing_instance', columns=None, start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain:default-project:ip-fabric:__default__;', 'keys': ['routing_instance'], 'start': 'default-domain:default-project:ip-fabric:__default__:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['routing_instance'], start='default-domain:default-project:ip-fabric:__default__:', finish='default-domain:default-project:ip-fabric:__default__;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['routing_instance', 'default-domain:default-project:ip-fabric:__default__:', 'default-domain:default-project:ip-fabric:__default__;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.692 7fe2412156d8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.698 7fe240874390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.712 7fe2408e44e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.714 7fe2405c9630 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.745 7fe2405c9630 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.787 7fe24097b6d8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.842 7fe240874390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.880 7fe2408e44e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.883 7fe2408444e0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.888 7fe2408444e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.923 7fe2408444e0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:25.927 7fe240844c18 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:25.930 7fe240844c18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:25.978 7fe240844c18 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 13 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:26.312 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:26.313 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:26.315 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:26.358 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:26.358 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:26.360 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:26.426 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:26.426 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:26.429 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:26.431 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:26.434 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:26.456 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:26.465 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:26.502 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:26.513 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:26.516 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:26.520 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:26.523 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:26.583 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:26.590 7fe2420fea20 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:26.626 7fe2420fea20 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:26.633 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:26.657 7fe240418d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:26.716 7fe240418d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:26.741 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:26.750 7fe240448b70 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:26.800 7fe240448b70 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 16 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:26 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:28.887 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:28.888 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:28.890 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:28.929 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:28.939 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:28.950 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:28.971 7fe232ddb390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:28.974 7fe232ddb390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:29.031 7fe232ddb390 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:29 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:28 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 17 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:28 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:29.040 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.040 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.057 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.060 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.061 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.063 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.088 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.088 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.098 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.109 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.110 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.120 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.122 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.125 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.134 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.135 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.138 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.142 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.145 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.193 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.193 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.195 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.389 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:29.389 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:29.395 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.403 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:29.414 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.415 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.449 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.469 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.482 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.492 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.493 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.623 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.640 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:29.657 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.665 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.672 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:29.690 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.693 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.708 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.718 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:29.947 7fe232370048 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:29.963 7fe240268978 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.027 7fe232370048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:30.109 7fe232370048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = functools.partial(>, 'global_system_config') args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py in wrapper(api_server_obj=, resource_type='global_system_config', *args=(), **kwargs={}) 16 def wrapper(api_server_obj, resource_type, *args, **kwargs): 17 if api_server_obj.enable_api_stats_log is False: 18 return func(api_server_obj, resource_type, *args, **kwargs) 19 else: 20 try: func = api_server_obj = resource_type = 'global_system_config' args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in http_resource_list(self=, obj_type='global_system_config') 1733 obj_uuids, is_count, is_detail, filters, 1734 req_fields, include_shared, exclude_hrefs, 1735 pagination) 1736 # end http_resource_list 1737 pagination = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in _list_collection(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, is_detail=False, filters={}, req_fields=[], include_shared=False, exclude_hrefs=False, pagination={}) 4121 include_shared=include_shared, 4122 paginate_start=page_start, 4123 paginate_count=page_count) 4124 if not ok: 4125 self.config_object_error(None, None, '%ss' %(obj_type), paginate_count undefined page_count = None /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in dbe_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, is_count=False, filters={}, paginate_start=None, paginate_count=None, is_detail=False, field_names=[], include_shared=False) 2343 count=flat_count, filters=filters, 2344 paginate_start=paginate_start, 2345 paginate_count=paginate_count) 2346 2347 if not ok or flat_count: paginate_count = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config',), **kwargs={'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config',) kwargs = {'back_ref_uuids': None, 'count': False, 'filters': {}, 'obj_uuids': None, 'paginate_count': None, 'paginate_start': None, 'parent_uuids': None} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in object_list(self=, obj_type='global_system_config', parent_uuids=None, back_ref_uuids=None, obj_uuids=None, count=False, filters={}, paginate_start=None, paginate_count=None) 1005 cols = self._cassandra_driver.xget( 1006 datastore_api.OBJ_FQ_NAME_CF_NAME, '%s' %(obj_type), 1007 start=start) 1008 1009 def filter_rows_no_anchor(): start = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'start': ''}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in xget(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 245 """Like get but creates a generator that pages over the columns automatically.""" 246 return self._XGet( 247 cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) 248 249 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = '' finish = '' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _XGet(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='') 825 finish=finish, 826 columns=columns, 827 _decode_json=False) 828 return six.iteritems(rows or {}) 829 _decode_json undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='', finish='', _decode_json=False) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = False /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_api_stats.py", line 18, in wrapper return func(api_server_obj, resource_type, *args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 1735, in http_resource_list pagination) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4123, in _list_collection paginate_count=page_count) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2345, in dbe_list paginate_count=paginate_count) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1007, in object_list start=start) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 247, in xget cf_name=cf_name, key=key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 827, in _XGet _decode_json=False) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': False, 'finish': '', 'keys': ['global_system_config'], 'start': ''} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='', finish='', num_columns=None, columns=None, include_timestamp=False, decode_json=False) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config']], *append_args=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config']] append_args = ('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config']], params=('\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', 'obj_fq_name_table', None, False, False, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ', args=[['global_system_config']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ...able"\n WHERE key = textAsBlob(%s)\n ' args = [['global_system_config']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.207 7fe240268978 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.244 7fe2334e6cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.248 7fe2420fea20 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.266 7fe232ec7eb8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.269 7fe240448b70 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.273 7fe2334e6cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:30.334 7fe2334e6cc0 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.391 7fe2420fea20 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.447 7fe232ec7eb8 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.519 7fe240448b70 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.528 7fe240418d68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:30.557 7fe240418d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:30.616 7fe240418d68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in obj_perms_http_get(self=) 2745 if domain == self._args.default_domain_id: 2746 domain = 'default-domain' 2747 domain = self._db_conn.fq_name_to_uuid('domain', [domain]) 2748 if domain: 2749 domain = domain.replace('-', '') domain = 'default-domain' self = self._db_conn = self._db_conn.fq_name_to_uuid = > /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'domain' fq_name = ['default-domain'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('domain', ['default-domain']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('domain', ['default-domain']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='domain', fq_name=['default-domain']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-domain' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'domain'), **kwargs={'finish': 'default-domain;', 'start': 'default-domain:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'domain') kwargs = {'finish': 'default-domain;', 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'domain' columns = None start = 'default-domain:' finish = 'default-domain;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='domain', columns=None, start='default-domain:', finish='default-domain;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2747, in obj_perms_http_get domain = self._db_conn.fq_name_to_uuid('domain', [domain]) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 24 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:30 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-domain;', 'keys': ['domain'], 'start': 'default-domain:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['domain'], start='default-domain:', finish='default-domain;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['domain', 'default-domain:', 'default-domain;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['domain', 'default-domain:', 'default-domain;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['domain', 'default-domain:', 'default-domain;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['domain', 'default-domain:', 'default-domain;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['domain', 'default-domain:', 'default-domain;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = ValueError('badly formed hexadecimal UUID string',) __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2743, in obj_perms_http_get domain = str(uuid.UUID(domain)) File "/usr/lib64/python3.6/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:30.936 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:30.936 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:30.939 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:30.978 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:30.978 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:30.981 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:31.018 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:31.043 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:31.081 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:31.085 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:31.106 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:31.117 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:31.231 7fe2402ddf60 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:31.257 7fe2402ddf60 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:31.361 7fe2402ddf60 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 26 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:31.395 7fe2402ecd68 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:31.403 7fe2402ecd68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Cassandra connection down. Exception in > 02/10/2025 01:56:31.499 7fe2402ecd68 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: DatabaseUnavailableError Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in handler_trap_exception(*args=(), **kwargs={}) 2532 (code, err_msg) = status 2533 raise cfgm_common.exceptions.HttpError(code, err_msg) 2534 response = handler(*args, **kwargs) 2535 self._generate_rest_api_response_trace(trace, response) 2536 response undefined handler = > args = () kwargs = {} /usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py in fq_name_to_id_http_post(self=) 3222 3223 try: 3224 id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) 3225 except NoIdError: 3226 if obj_type in ['domain', 'project']: builtinid = self = self._db_conn = self._db_conn.fq_name_to_uuid = > obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 2497 2498 def fq_name_to_uuid(self, obj_type, fq_name): 2499 obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) 2500 return obj_uuid 2501 # end fq_name_to_uuid obj_uuid undefined self = self._object_db = self._object_db.fq_name_to_uuid = .wrapper> obj_type = 'global_system_config' fq_name = ['default-global-system-config'] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=('global_system_config', ['default-global-system-config']), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = ('global_system_config', ['default-global-system-config']) kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in fq_name_to_uuid(self=, obj_type='global_system_config', fq_name=['default-global-system-config']) 1195 obj_type, 1196 start=fq_name_str + ':', 1197 finish=fq_name_str + ';') 1198 if not col_infos: 1199 raise NoIdError('%s %s' % (obj_type, fq_name_str)) finish undefined fq_name_str = 'default-global-system-config' /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in wrapped(self=, *args=('obj_fq_name_table', 'global_system_config'), **kwargs={'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'}) 122 return r 123 else: 124 return f(self, *args, **kwargs) 125 return wrapped 126 f = self = args = ('obj_fq_name_table', 'global_system_config') kwargs = {'finish': 'default-global-system-config;', 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py in get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;') 235 """Fetch one row in a column family""" 236 return self._Get( 237 cf_name, key, columns=columns, start=start, finish=finish) 238 239 @abc.abstractmethod cf_name = 'obj_fq_name_table' key = 'global_system_config' columns = None start = 'default-global-system-config:' finish = 'default-global-system-config;' /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get(self=, cf_name='obj_fq_name_table', key='global_system_config', columns=None, start='default-global-system-config:', finish='default-global-system-config;', _decode_json=None) 838 finish=finish, 839 columns=columns, 840 decode_json=_decode_json): 841 return rows 842 decode_json undefined _decode_json = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = .wrapper> args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1040 raise DatabaseUnavailableError( 1041 "error, {}: {}".format( 1042 e, utils.detailed_traceback())) 1043 finally: 1044 if ((self.log_response_time) and (oper)): e undefined global utils = utils.detailed_traceback = DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None __cause__ = None __class__ = __context__ = NoHostAvailable('Unable to complete the operatio...quired_replicas\': 2, \'alive_replicas\': 1}',)}) __delattr__ = __dict__ = {'_db_type': "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n", '_reason_code': None} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cfgm_common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _db_type = "error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n" _reason_code = None args = ("error, ('Unable to complete the operation agains...red_replicas\\': 2, \\'alive_replicas\\': 1}',)})\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 2534, in handler_trap_exception response = handler(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3224, in fq_name_to_id_http_post id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2499, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1197, in fq_name_to_uuid finish=fq_name_str + ';') File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 124, in wrapped return f(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/api.py", line 237, in get cf_name, key, columns=columns, start=start, finish=finish) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 840, in _Get decode_json=_decode_json): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) [Previous line repeated 26 more times] File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1042, in wrapper e, utils.detailed_traceback())) cfgm_common.exceptions.DatabaseUnavailableError: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Feb 10 01:56:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {'cf_name': 'obj_fq_name_table', 'columns': None, 'decode_json': None, 'finish': 'default-global-system-config;', 'keys': ['global_system_config'], 'start': 'default-global-system-config:'} /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _cql_select(self=, cf_name='obj_fq_name_table', keys=['global_system_config'], start='default-global-system-config:', finish='default-global-system-config;', num_columns=None, columns=None, include_timestamp=False, decode_json=None) 779 include_timestamp, 780 decode_json, 781 num_columns) 782 return req 783 num_columns = None /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in compute(self=, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], *append_args=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 1160 def terminate_workers(self): 1161 pass 1162 1163 def compute(self, args, *append_args): 1164 return self.target(0, 0, args, append_args) self = self.target = > args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] append_args = ('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None) /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in worker(self=, group_id=0, worker_id=0, args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']], params=('\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', 'obj_fq_name_table', None, False, None, None)) 724 keys = [a[0] for a in args] 725 726 req = self.apply(ses, cql, args) 727 req = zip(keys, req) 728 req = Iter(req, req undefined self = self.apply = > ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in apply(self=, ses=, cql='\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ', args=[['global_system_config', 'default-global-system-config:', 'default-global-system-config;']]) 975 return [(True, ses.execute(cql, arg)) for arg in args] 976 return connector.concurrent.execute_concurrent_with_args( 977 ses, cql, args, concurrency=self.options.concurrency) 978 979 def _Remove(self, key, columns=None, keyspace_name=None, cf_name=None, ses = cql = '\n SELECT blobAsText(column1), value\n ... >= textAsBlob(%s) AND column1 <= textAsBlob(%s) ' args = [['global_system_config', 'default-global-system-config:', 'default-global-system-config;']] concurrency undefined self = self.options = Options(db_prefix='', rw_keyspaces={'config_db_u...ne, zk_ssl_certificate=None, zk_ssl_ca_cert=None) self.options.concurrency = 1000 /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent_with_args() /cassandra/concurrent.py in cassandra.concurrent.execute_concurrent() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults.execute() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor.execute() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent.ConcurrentExecutorListResults._results() /cassandra/concurrent.py in cassandra.concurrent._ConcurrentExecutor._raise() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 781, in _cql_select num_columns) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1164, in compute return self.target(0, 0, args, append_args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 726, in worker req = self.apply(ses, cql, args) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 977, in apply ses, cql, args, concurrency=self.options.concurrency) File "cassandra/concurrent.py", line 243, in cassandra.concurrent.execute_concurrent_with_args File "cassandra/concurrent.py", line 98, in cassandra.concurrent.execute_concurrent File "cassandra/concurrent.py", line 206, in cassandra.concurrent.ConcurrentExecutorListResults.execute File "cassandra/concurrent.py", line 125, in cassandra.concurrent._ConcurrentExecutor.execute File "cassandra/concurrent.py", line 220, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 224, in cassandra.concurrent.ConcurrentExecutorListResults._results File "cassandra/concurrent.py", line 172, in cassandra.concurrent._ConcurrentExecutor._raise cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 02/10/2025 01:56:36.197 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:56:36.198 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:56:36.203 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:56:36.272 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:56:36.302 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:56:36.324 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:56:36.394 7fe2315b4438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 02/10/2025 01:56:39.481 7fe2312a2a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c132f712-0f40-4d84-8526-ff746c5eb961 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-3 url = http://10.0.0.17:8082/bgp-router/c132f712-0f40-4d84-8526-ff746c5eb961 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": "c132f712-0f40-4d84-8526-ff746c5eb961", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.8", "address": "10.20.0.8", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:39.629 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-3'], 'oper': 'UPDATE', 'request-id': 'req-d7a3a1b2-059a-43c7-b978-e6e83bb28404', 'type': 'bgp_router', 'uuid': 'c132f712-0f40-4d84-8526-ff746c5eb961'} 02/10/2025 01:56:40.880 7fe23126e2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9ace496e-24e3-4a41-918e-2a6e3adb9920 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2705-2 url = http://10.0.0.17:8082/bgp-router/9ace496e-24e3-4a41-918e-2a6e3adb9920 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"bgp-router": {"uuid": "9ace496e-24e3-4a41-918e-2a6e3adb9920", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:40.918 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2705-2'], 'oper': 'UPDATE', 'request-id': 'req-d62a0b51-e0ed-4cd6-90e7-c89f1323f257', 'type': 'bgp_router', 'uuid': '9ace496e-24e3-4a41-918e-2a6e3adb9920'} 02/10/2025 01:56:42.912 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-126d4dea-fb79-4f55-8e54-c7cc702a7f85', 'type': 'application_policy_set', 'uuid': 'e6302dd6-2f1e-4680-9e0d-f0754a1af492'} 02/10/2025 01:56:43.210 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-96f1c634-45bd-4d2b-a227-09743d872d02', 'type': 'application_policy_set', 'uuid': 'e6302dd6-2f1e-4680-9e0d-f0754a1af492'} 02/10/2025 01:56:43.533 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-3bd5d225-b520-484f-bc36-eb7d8ab2f4ec', 'type': 'network_ipam', 'uuid': '3286a621-cbde-439f-aabc-a278a3a37562'} 02/10/2025 01:56:43.580 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-07a79194-7335-4f03-a4b5-189e6cb69e88', 'type': 'project', 'uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7'} 02/10/2025 01:56:43.748 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-d2a85e70-1f92-4275-92c1-130d2d2ed809', 'type': 'network_ipam', 'uuid': '3286a621-cbde-439f-aabc-a278a3a37562'} 02/10/2025 01:56:43.797 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-f6bc64e2-7117-4004-9e13-072c02734f19', 'type': 'project', 'uuid': '39a719a6-69b7-4d13-b619-34be5eda63c7'} 02/10/2025 01:56:44.417 7fe23125b198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0f1c21ec-23a8-4d73-900c-5eeac6f66c59 object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-1 url = http://10.0.0.17:8082/virtual-router/0f1c21ec-23a8-4d73-900c-5eeac6f66c59 operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"virtual-router": {"uuid": "0f1c21ec-23a8-4d73-900c-5eeac6f66c59", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:44.460 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1'], 'oper': 'UPDATE', 'request-id': 'req-d420bb56-8e1a-4fab-bb17-d7b2a24b2f6f', 'type': 'virtual_router', 'uuid': '0f1c21ec-23a8-4d73-900c-5eeac6f66c59'} 02/10/2025 01:56:44.724 7fe231204cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 247d8a3e-5cbb-457f-b7b1-b06e2b465fe3 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-1:vhost0 url = http://10.0.0.17:8082/virtual-machine-interface/247d8a3e-5cbb-457f-b7b1-b06e2b465fe3 operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.47 body = {"virtual-machine-interface": {"uuid": "247d8a3e-5cbb-457f-b7b1-b06e2b465fe3", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:44.813 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-c897dbc9-9b55-4d46-bf30-9dadc98c467f', 'type': 'virtual_machine_interface', 'uuid': '247d8a3e-5cbb-457f-b7b1-b06e2b465fe3'} 02/10/2025 01:56:44.880 7fe2312a2ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4d5a170e-0c97-4638-ba72-d2de10ee5e0c object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-2 url = http://10.0.0.17:8082/virtual-router/4d5a170e-0c97-4638-ba72-d2de10ee5e0c operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"virtual-router": {"uuid": "4d5a170e-0c97-4638-ba72-d2de10ee5e0c", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:44.934 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2'], 'oper': 'UPDATE', 'request-id': 'req-04332d02-e6cc-4b83-a658-a9378a1c033d', 'type': 'virtual_router', 'uuid': '4d5a170e-0c97-4638-ba72-d2de10ee5e0c'} 02/10/2025 01:56:45.182 7fe23122fe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a839f0e-b397-4358-ba7a-0ffb539ef533 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2705-2:vhost0 url = http://10.0.0.17:8082/virtual-machine-interface/1a839f0e-b397-4358-ba7a-0ffb539ef533 operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.27 body = {"virtual-machine-interface": {"uuid": "1a839f0e-b397-4358-ba7a-0ffb539ef533", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:45.220 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2705-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-0d6872e4-6711-40b3-8fb4-45371c2b2491', 'type': 'virtual_machine_interface', 'uuid': '1a839f0e-b397-4358-ba7a-0ffb539ef533'} 02/10/2025 01:56:52.183 7fe2311dfac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.17"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:52.256 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-ddd3ea39-5554-40a3-b482-864b20b0065a', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:56:52.817 7fe2311f7588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.17"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:52.899 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1e12f1d9-19c2-4cf6-81fe-956039a64198', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:56:53.348 7fe241f18438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2a939987-174a-4630-a8da-73397c24674f object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.17:8082/alarm/2a939987-174a-4630-a8da-73397c24674f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2a939987-174a-4630-a8da-73397c24674f", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:53.399 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-9e48a7f5-21d7-4ebd-b5e3-1a3b5c6c751d', 'type': 'alarm', 'uuid': '2a939987-174a-4630-a8da-73397c24674f'} 02/10/2025 01:56:53.552 7fe2311ed630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98901035-1a90-4367-b454-9d41526685d5 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.17:8082/alarm/98901035-1a90-4367-b454-9d41526685d5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "98901035-1a90-4367-b454-9d41526685d5", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:53.584 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-8558aeef-3b4f-4559-a9ad-a72048223e18', 'type': 'alarm', 'uuid': '98901035-1a90-4367-b454-9d41526685d5'} 02/10/2025 01:56:53.738 7fe2311d2f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0aee762e-947e-4b77-b51d-06a638ff1416 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.17:8082/alarm/0aee762e-947e-4b77-b51d-06a638ff1416 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "0aee762e-947e-4b77-b51d-06a638ff1416", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:53.770 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-0548e281-3279-4313-b04d-43d14a7b6a06', 'type': 'alarm', 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416'} 02/10/2025 01:56:53.821 7fe23122f048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2a939987-174a-4630-a8da-73397c24674f object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.17:8082/alarm/2a939987-174a-4630-a8da-73397c24674f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "2a939987-174a-4630-a8da-73397c24674f", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:53.873 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-d97cfcbe-cf0f-4272-8fef-ba8397b6e85f', 'type': 'alarm', 'uuid': '2a939987-174a-4630-a8da-73397c24674f'} 02/10/2025 01:56:53.925 7fe241f17f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0178b28a-a433-43ba-9da4-a64837443cd2 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.17:8082/alarm/0178b28a-a433-43ba-9da4-a64837443cd2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "0178b28a-a433-43ba-9da4-a64837443cd2", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:53.954 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-881095f9-74f8-4e55-8e4d-f0d8b3c4bd31', 'type': 'alarm', 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2'} 02/10/2025 01:56:54.035 7fe233689e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98901035-1a90-4367-b454-9d41526685d5 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.17:8082/alarm/98901035-1a90-4367-b454-9d41526685d5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "98901035-1a90-4367-b454-9d41526685d5", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.096 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-5e204eb0-33ee-455e-ae48-17ad3ec597a0', 'type': 'alarm', 'uuid': '98901035-1a90-4367-b454-9d41526685d5'} 02/10/2025 01:56:54.126 7fe231331198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.17:8082/alarm/19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.168 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-25d320d1-5261-4070-abfe-411daa28680b', 'type': 'alarm', 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1'} 02/10/2025 01:56:54.244 7fe2407f1630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0aee762e-947e-4b77-b51d-06a638ff1416 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.17:8082/alarm/0aee762e-947e-4b77-b51d-06a638ff1416 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "0aee762e-947e-4b77-b51d-06a638ff1416", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.286 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-ca431673-1d67-4b3a-b2c0-e2e0bc8f9c8a', 'type': 'alarm', 'uuid': '0aee762e-947e-4b77-b51d-06a638ff1416'} 02/10/2025 01:56:54.336 7fe2311e38d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc9711dd-e3ff-47f9-a2e4-1caf32206d9e object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.17:8082/alarm/cc9711dd-e3ff-47f9-a2e4-1caf32206d9e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "cc9711dd-e3ff-47f9-a2e4-1caf32206d9e", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.375 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-220b21ab-4f74-4ae5-9b9d-eb313077c337', 'type': 'alarm', 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e'} 02/10/2025 01:56:54.448 7fe231331198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0178b28a-a433-43ba-9da4-a64837443cd2 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.17:8082/alarm/0178b28a-a433-43ba-9da4-a64837443cd2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "0178b28a-a433-43ba-9da4-a64837443cd2", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.516 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8ae9e6d2-2ab1-4094-ae8c-6e69445c00b2', 'type': 'alarm', 'uuid': '0178b28a-a433-43ba-9da4-a64837443cd2'} 02/10/2025 01:56:54.533 7fe2311cc4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 86f1ad31-9dc1-4348-93aa-c50f982e3244 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.17:8082/alarm/86f1ad31-9dc1-4348-93aa-c50f982e3244 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "86f1ad31-9dc1-4348-93aa-c50f982e3244", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.588 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-c7f21fdf-7917-4ab6-bd61-1c3c44961d6c', 'type': 'alarm', 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244'} 02/10/2025 01:56:54.679 7fe23345d978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.17:8082/alarm/19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.729 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-4a119ba6-4d2d-4d99-8ab3-764441375bf1', 'type': 'alarm', 'uuid': '19e062e4-f1e1-4d7b-abd4-2f05a89a9ad1'} 02/10/2025 01:56:54.771 7fe241f16630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 964d465d-ed7a-400f-8517-c45857e2c37c object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.17:8082/alarm/964d465d-ed7a-400f-8517-c45857e2c37c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "964d465d-ed7a-400f-8517-c45857e2c37c", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.830 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-4fd1c06d-15fd-4ced-9161-409921150d84', 'type': 'alarm', 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c'} 02/10/2025 01:56:54.904 7fe23120bf60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cc9711dd-e3ff-47f9-a2e4-1caf32206d9e object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.17:8082/alarm/cc9711dd-e3ff-47f9-a2e4-1caf32206d9e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "cc9711dd-e3ff-47f9-a2e4-1caf32206d9e", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:54.957 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-573201d7-75f4-4c1b-924c-0397fbe104bb', 'type': 'alarm', 'uuid': 'cc9711dd-e3ff-47f9-a2e4-1caf32206d9e'} 02/10/2025 01:56:54.990 7fe2312548d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ed76365-e4b5-4a95-bd86-9804aecbe68f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.17:8082/alarm/5ed76365-e4b5-4a95-bd86-9804aecbe68f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "5ed76365-e4b5-4a95-bd86-9804aecbe68f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.059 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-d3edb30c-f795-4b58-b103-3fad3ef835fd', 'type': 'alarm', 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f'} 02/10/2025 01:56:55.126 7fe23141a0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 86f1ad31-9dc1-4348-93aa-c50f982e3244 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.17:8082/alarm/86f1ad31-9dc1-4348-93aa-c50f982e3244 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "86f1ad31-9dc1-4348-93aa-c50f982e3244", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.172 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-a7ca1662-9662-4c32-bb55-346fca41f542', 'type': 'alarm', 'uuid': '86f1ad31-9dc1-4348-93aa-c50f982e3244'} 02/10/2025 01:56:55.251 7fe2311c3ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ef05a83b-0fef-44fc-bdcd-3014532933df object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.17:8082/alarm/ef05a83b-0fef-44fc-bdcd-3014532933df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "ef05a83b-0fef-44fc-bdcd-3014532933df", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.297 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-6f68c661-e97b-4caa-8b75-3a9016478409', 'type': 'alarm', 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df'} 02/10/2025 01:56:55.326 7fe231280978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 964d465d-ed7a-400f-8517-c45857e2c37c object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.17:8082/alarm/964d465d-ed7a-400f-8517-c45857e2c37c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "964d465d-ed7a-400f-8517-c45857e2c37c", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.369 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-289851f2-1be5-4abc-b97f-27d6546982be', 'type': 'alarm', 'uuid': '964d465d-ed7a-400f-8517-c45857e2c37c'} 02/10/2025 01:56:55.458 7fe241f14780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22540ebc-1bb6-4c67-8089-f156b03c8077 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.17:8082/alarm/22540ebc-1bb6-4c67-8089-f156b03c8077 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "22540ebc-1bb6-4c67-8089-f156b03c8077", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.516 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-ca634da5-5b06-4598-bb52-45210c9c7946', 'type': 'alarm', 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077'} 02/10/2025 01:56:55.550 7fe2311e3b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ed76365-e4b5-4a95-bd86-9804aecbe68f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.17:8082/alarm/5ed76365-e4b5-4a95-bd86-9804aecbe68f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "5ed76365-e4b5-4a95-bd86-9804aecbe68f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.631 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-ca66060f-d528-49e1-a99b-788fc5148cab', 'type': 'alarm', 'uuid': '5ed76365-e4b5-4a95-bd86-9804aecbe68f'} 02/10/2025 01:56:55.693 7fe232e09e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7b65efe3-84e9-4738-b7e0-a3238c3cce77 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.17:8082/alarm/7b65efe3-84e9-4738-b7e0-a3238c3cce77 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7b65efe3-84e9-4738-b7e0-a3238c3cce77", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.731 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-7672342b-d4dc-4b9e-aaa1-f38e6ddbcb5d', 'type': 'alarm', 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77'} 02/10/2025 01:56:55.786 7fe241f1e048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ef05a83b-0fef-44fc-bdcd-3014532933df object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.17:8082/alarm/ef05a83b-0fef-44fc-bdcd-3014532933df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "ef05a83b-0fef-44fc-bdcd-3014532933df", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.820 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-655d05e6-c141-41cc-9b17-e259b46d09b0', 'type': 'alarm', 'uuid': 'ef05a83b-0fef-44fc-bdcd-3014532933df'} 02/10/2025 01:56:55.902 7fe231435d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c1ad1824-6f42-4412-8542-66c11c31f4bf object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.17:8082/alarm/c1ad1824-6f42-4412-8542-66c11c31f4bf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "c1ad1824-6f42-4412-8542-66c11c31f4bf", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:55.951 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-2d7ffd6b-7b40-46de-8449-9eb42c865569', 'type': 'alarm', 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf'} 02/10/2025 01:56:55.979 7fe2311dbd68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22540ebc-1bb6-4c67-8089-f156b03c8077 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.17:8082/alarm/22540ebc-1bb6-4c67-8089-f156b03c8077 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "22540ebc-1bb6-4c67-8089-f156b03c8077", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.073 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-4d3e3270-b53a-4e43-930e-6a1444b364f3', 'type': 'alarm', 'uuid': '22540ebc-1bb6-4c67-8089-f156b03c8077'} 02/10/2025 01:56:56.136 7fe2312bc240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6f2c7f5e-83ca-4645-a96c-ae42d14f0adc object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.17:8082/alarm/6f2c7f5e-83ca-4645-a96c-ae42d14f0adc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "6f2c7f5e-83ca-4645-a96c-ae42d14f0adc", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.176 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-e241d12a-0227-4653-b061-9de011e55d80', 'type': 'alarm', 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc'} 02/10/2025 01:56:56.235 7fe232366cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7b65efe3-84e9-4738-b7e0-a3238c3cce77 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.17:8082/alarm/7b65efe3-84e9-4738-b7e0-a3238c3cce77 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7b65efe3-84e9-4738-b7e0-a3238c3cce77", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.280 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-c96f7672-8568-479c-bb19-50f506036fe9', 'type': 'alarm', 'uuid': '7b65efe3-84e9-4738-b7e0-a3238c3cce77'} 02/10/2025 01:56:56.383 7fe231435a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c47084c-9b12-4342-853f-7bbfa17faf73 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.17:8082/alarm/7c47084c-9b12-4342-853f-7bbfa17faf73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7c47084c-9b12-4342-853f-7bbfa17faf73", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.432 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-0b2fccfc-a4c0-4141-8358-176988e9109a', 'type': 'alarm', 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73'} 02/10/2025 01:56:56.444 7fe2313cba20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c1ad1824-6f42-4412-8542-66c11c31f4bf object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.17:8082/alarm/c1ad1824-6f42-4412-8542-66c11c31f4bf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "c1ad1824-6f42-4412-8542-66c11c31f4bf", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.547 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-f5b8047b-952a-4d62-8189-06e756518c41', 'type': 'alarm', 'uuid': 'c1ad1824-6f42-4412-8542-66c11c31f4bf'} 02/10/2025 01:56:56.591 7fe2325a3cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f93761e4-b956-48f1-81ab-e409bcffec3b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.17:8082/alarm/f93761e4-b956-48f1-81ab-e409bcffec3b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f93761e4-b956-48f1-81ab-e409bcffec3b", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.643 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-9a86be8a-5eef-42c3-bded-4a1944ebda0a', 'type': 'alarm', 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b'} 02/10/2025 01:56:56.706 7fe23123e240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6f2c7f5e-83ca-4645-a96c-ae42d14f0adc object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.17:8082/alarm/6f2c7f5e-83ca-4645-a96c-ae42d14f0adc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "6f2c7f5e-83ca-4645-a96c-ae42d14f0adc", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.737 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-3e2181ec-b981-4da3-ae3a-e63f1a948e31', 'type': 'alarm', 'uuid': '6f2c7f5e-83ca-4645-a96c-ae42d14f0adc'} 02/10/2025 01:56:56.799 7fe23132d2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f771b32f-0d19-4472-adcb-3a310619c820 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.17:8082/alarm/f771b32f-0d19-4472-adcb-3a310619c820 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "f771b32f-0d19-4472-adcb-3a310619c820", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.855 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-3acd3d00-889b-451d-9def-b8c466c44af8', 'type': 'alarm', 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820'} 02/10/2025 01:56:56.930 7fe233689e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7c47084c-9b12-4342-853f-7bbfa17faf73 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.17:8082/alarm/7c47084c-9b12-4342-853f-7bbfa17faf73 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7c47084c-9b12-4342-853f-7bbfa17faf73", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:56.994 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-11a87683-333a-4a6c-9212-0df2254ba138', 'type': 'alarm', 'uuid': '7c47084c-9b12-4342-853f-7bbfa17faf73'} 02/10/2025 01:56:57.030 7fe231325a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7e4d3ead-0b84-43a1-95b2-684d72fb99bd object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.17:8082/alarm/7e4d3ead-0b84-43a1-95b2-684d72fb99bd operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7e4d3ead-0b84-43a1-95b2-684d72fb99bd", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.093 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-9dfe2e30-0efe-46f1-af0e-152196a19895', 'type': 'alarm', 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd'} 02/10/2025 01:56:57.141 7fe23122acc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f93761e4-b956-48f1-81ab-e409bcffec3b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.17:8082/alarm/f93761e4-b956-48f1-81ab-e409bcffec3b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "f93761e4-b956-48f1-81ab-e409bcffec3b", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.214 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b353eb31-58bd-44a6-bbbd-aec6a1756f91', 'type': 'alarm', 'uuid': 'f93761e4-b956-48f1-81ab-e409bcffec3b'} 02/10/2025 01:56:57.248 7fe23120bb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd30bb3-7cae-4b9d-ac01-599e99ff42dc object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.17:8082/alarm/bbd30bb3-7cae-4b9d-ac01-599e99ff42dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bbd30bb3-7cae-4b9d-ac01-599e99ff42dc", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.314 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-c430edc2-2ca5-4628-8057-a394e71fc468', 'type': 'alarm', 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc'} 02/10/2025 01:56:57.381 7fe244f11828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f771b32f-0d19-4472-adcb-3a310619c820 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.17:8082/alarm/f771b32f-0d19-4472-adcb-3a310619c820 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "f771b32f-0d19-4472-adcb-3a310619c820", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.448 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-c6857fae-4f98-40c3-9c2d-f58ea8692805', 'type': 'alarm', 'uuid': 'f771b32f-0d19-4472-adcb-3a310619c820'} 02/10/2025 01:56:57.475 7fe2311dfb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7167e02f-cb20-4602-858a-23c3f9219cf2 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.17:8082/alarm/7167e02f-cb20-4602-858a-23c3f9219cf2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "7167e02f-cb20-4602-858a-23c3f9219cf2", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.539 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-d527ea8e-3921-4887-92b7-1b3472ee8528', 'type': 'alarm', 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2'} 02/10/2025 01:56:57.603 7fe2401d7780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7e4d3ead-0b84-43a1-95b2-684d72fb99bd object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.17:8082/alarm/7e4d3ead-0b84-43a1-95b2-684d72fb99bd operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7e4d3ead-0b84-43a1-95b2-684d72fb99bd", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.692 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-a8db47c5-3614-47a8-97c9-e868901beea3', 'type': 'alarm', 'uuid': '7e4d3ead-0b84-43a1-95b2-684d72fb99bd'} 02/10/2025 01:56:57.716 7fe2311f20f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bc1530f8-d883-45f8-9a25-132b83db8fbe object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.17:8082/alarm/bc1530f8-d883-45f8-9a25-132b83db8fbe operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "bc1530f8-d883-45f8-9a25-132b83db8fbe", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.769 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-fdc187ab-cae8-40aa-aa9f-ebf14a90f156', 'type': 'alarm', 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe'} 02/10/2025 01:56:57.853 7fe23122ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbd30bb3-7cae-4b9d-ac01-599e99ff42dc object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.17:8082/alarm/bbd30bb3-7cae-4b9d-ac01-599e99ff42dc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "bbd30bb3-7cae-4b9d-ac01-599e99ff42dc", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.882 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-32d6139a-38a0-44c1-b52e-21838d5859f3', 'type': 'alarm', 'uuid': 'bbd30bb3-7cae-4b9d-ac01-599e99ff42dc'} 02/10/2025 01:56:57.954 7fe2311c64e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.17:8082/alarm/2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:57.989 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-e3965306-a485-41e7-a7b6-cc4f5b474270', 'type': 'alarm', 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4'} 02/10/2025 01:56:58.049 7fe2407d5cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7167e02f-cb20-4602-858a-23c3f9219cf2 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.17:8082/alarm/7167e02f-cb20-4602-858a-23c3f9219cf2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "7167e02f-cb20-4602-858a-23c3f9219cf2", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:58.089 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-5e075952-118a-4a5a-a1f6-d2179b4b122b', 'type': 'alarm', 'uuid': '7167e02f-cb20-4602-858a-23c3f9219cf2'} 02/10/2025 01:56:58.150 7fe241ed1198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.17:8082/alarm/a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.12 body = {"alarm": {"uuid": "a5c5a4c8-d067-4b39-8ab4-f2ba87f92191", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:58.192 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-9880580d-7ea3-476f-b7cf-b919b926dd6b', 'type': 'alarm', 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191'} 02/10/2025 01:56:58.225 7fe241eec2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bc1530f8-d883-45f8-9a25-132b83db8fbe object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.17:8082/alarm/bc1530f8-d883-45f8-9a25-132b83db8fbe operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "bc1530f8-d883-45f8-9a25-132b83db8fbe", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:58.258 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-4f2c84a2-2634-4cac-bc3b-855cb9f73c6f', 'type': 'alarm', 'uuid': 'bc1530f8-d883-45f8-9a25-132b83db8fbe'} 02/10/2025 01:56:58.409 7fe24074f6d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.17:8082/alarm/2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:58.440 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-aded251c-bb21-4361-b232-58c14b5cab12', 'type': 'alarm', 'uuid': '2ab0ca20-5384-4bcf-aaa7-f7193c0bb2b4'} 02/10/2025 01:56:58.447 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-57512618-e9c6-48eb-80ca-30e9510d0c89', 'type': 'access_control_list', 'uuid': '93bd8fdc-1098-4284-8f0a-ab40458fa26a'} 02/10/2025 01:56:58.595 7fe23125b630 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.17:8082/alarm/a5c5a4c8-d067-4b39-8ab4-f2ba87f92191 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": "a5c5a4c8-d067-4b39-8ab4-f2ba87f92191", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:58.650 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-e205a5ac-0d62-4da5-94c0-dbdf7c5ae9a0', 'type': 'alarm', 'uuid': 'a5c5a4c8-d067-4b39-8ab4-f2ba87f92191'} 02/10/2025 01:56:59.798 7fe23131b588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:56:59.816 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-df18103e-b769-45f1-bd71-22885cb21999', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:57:00.164 7fe2312a2240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4654c223-6340-4978-aec5-7c777675e3f9 object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = http://10.0.0.17:8082/job-template/4654c223-6340-4978-aec5-7c777675e3f9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "4654c223-6340-4978-aec5-7c777675e3f9", "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.174 7fe2312120f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.196 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-082648e7-008c-41ac-89c2-e29eca8d404f', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:57:00.201 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'oper': 'UPDATE', 'request-id': 'req-46af6208-b3f9-477e-821f-6d227eba4c86', 'type': 'job_template', 'uuid': '4654c223-6340-4978-aec5-7c777675e3f9'} 02/10/2025 01:57:00.296 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'oper': 'UPDATE', 'request-id': 'req-30ebe624-a1a9-4ee3-8b1c-3b735f6ae382', 'type': 'job_template', 'uuid': 'b2f8c3c6-a69e-48e1-93e4-d69188dd4058'} 02/10/2025 01:57:00.391 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cli_sync_template'], 'oper': 'UPDATE', 'request-id': 'req-108eeb30-f9e4-4ba8-b433-b480143d6ad3', 'type': 'job_template', 'uuid': '69856fbf-4cf3-435d-919e-c7dd78d4fa44'} 02/10/2025 01:57:00.415 7fe2312a2f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2761a684-8c27-4997-acf9-adfa70b65189 object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = http://10.0.0.17:8082/job-template/2761a684-8c27-4997-acf9-adfa70b65189 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "2761a684-8c27-4997-acf9-adfa70b65189", "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.445 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'oper': 'UPDATE', 'request-id': 'req-af5cd631-7d28-432b-b179-598347e89402', 'type': 'job_template', 'uuid': '2761a684-8c27-4997-acf9-adfa70b65189'} 02/10/2025 01:57:00.534 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'oper': 'UPDATE', 'request-id': 'req-9cfdf38f-4bb2-4e7a-b51b-eef412b0b06e', 'type': 'job_template', 'uuid': '083e4d6b-e4d1-4ffd-b98c-08d50fd0a996'} 02/10/2025 01:57:00.581 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'oper': 'UPDATE', 'request-id': 'req-255c4636-2a42-495b-a058-cd330ee90565', 'type': 'job_template', 'uuid': '8079870c-a9f0-4a93-9dda-3bc5eca68f9b'} 02/10/2025 01:57:00.601 7fe2312546d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a1b210e2-1611-496d-a7a0-ed0a84533694 object_type = job_template identifier_name = default-global-system-config:discover_device_template url = http://10.0.0.17:8082/job-template/a1b210e2-1611-496d-a7a0-ed0a84533694 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "a1b210e2-1611-496d-a7a0-ed0a84533694", "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.682 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_device_template'], 'oper': 'UPDATE', 'request-id': 'req-e69fc5fa-70c2-40ee-b834-9e1845f38773', 'type': 'job_template', 'uuid': 'a1b210e2-1611-496d-a7a0-ed0a84533694'} 02/10/2025 01:57:00.737 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'oper': 'UPDATE', 'request-id': 'req-63e205d5-495d-44af-95bc-85cb579ea1c4', 'type': 'job_template', 'uuid': '39abf1b9-29ab-4745-9ef0-5a7d63db1939'} 02/10/2025 01:57:00.805 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_role_template'], 'oper': 'UPDATE', 'request-id': 'req-af7b38df-d902-4079-ab75-ebec6110784d', 'type': 'job_template', 'uuid': '4ea1b2c7-0b18-421c-8d07-25707b6b38a7'} 02/10/2025 01:57:00.807 7fe231254780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.12 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.835 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-808ba996-6d06-44fe-8089-671ca6a37e15', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:57:00.871 7fe2312548d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4364c5d1-efe3-4575-93d1-38ac40ac2e1a object_type = job_template identifier_name = default-global-system-config:device_import_template url = http://10.0.0.17:8082/job-template/4364c5d1-efe3-4575-93d1-38ac40ac2e1a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "4364c5d1-efe3-4575-93d1-38ac40ac2e1a", "fq_name": ["default-global-system-config", "device_import_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 1}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"additionalProperties\": false, \"properties\": {\"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported.\"}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Import"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:00.903 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_import_template'], 'oper': 'UPDATE', 'request-id': 'req-f1140996-49c1-47e5-a453-e14926298abd', 'type': 'job_template', 'uuid': '4364c5d1-efe3-4575-93d1-38ac40ac2e1a'} 02/10/2025 01:57:00.942 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'oper': 'UPDATE', 'request-id': 'req-32726491-8480-4ee4-b5ed-1d21f019c2a0', 'type': 'job_template', 'uuid': 'c7e22bd3-21d9-4ee5-8bdd-19516f489f15'} 02/10/2025 01:57:00.991 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'oper': 'UPDATE', 'request-id': 'req-92bf9fb8-908e-4f86-82e2-c5f48684e17a', 'type': 'job_template', 'uuid': '23c85dc4-c940-4fae-b674-72a069a57e81'} 02/10/2025 01:57:01.024 7fe23125bcc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a14a400-7dfc-4b4e-9573-1f7808c77b89 object_type = job_template identifier_name = default-global-system-config:fabric_deletion_template url = http://10.0.0.17:8082/job-template/7a14a400-7dfc-4b4e-9573-1f7808c77b89 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "7a14a400-7dfc-4b4e-9573-1f7808c77b89", "fq_name": ["default-global-system-config", "fabric_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Deletion"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.072 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'oper': 'UPDATE', 'request-id': 'req-2ef4dcb7-b853-47bb-bd8c-0d0d92f37678', 'type': 'job_template', 'uuid': '7a14a400-7dfc-4b4e-9573-1f7808c77b89'} 02/10/2025 01:57:01.134 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_deletion_template'], 'oper': 'UPDATE', 'request-id': 'req-6995effa-d86c-4df8-89b0-d7e89d7bedd6', 'type': 'job_template', 'uuid': 'bb5247dd-384f-4591-b08b-07a711c317ef'} 02/10/2025 01:57:01.180 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'role_assignment_template'], 'oper': 'UPDATE', 'request-id': 'req-af52f706-3bde-49e9-b790-2ccca4209c37', 'type': 'job_template', 'uuid': '41556dd8-b1a2-4814-83e7-c01dc76db65e'} 02/10/2025 01:57:01.213 7fe2311f2240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 62caf2a4-6ceb-4097-a39b-f3995282dc78 object_type = job_template identifier_name = default-global-system-config:topology_discovery_template url = http://10.0.0.17:8082/job-template/62caf2a4-6ceb-4097-a39b-f3995282dc78 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "62caf2a4-6ceb-4097-a39b-f3995282dc78", "fq_name": ["default-global-system-config", "topology_discovery_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Topology Discovery"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.249 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'oper': 'UPDATE', 'request-id': 'req-f871b9d9-b986-4cda-8f91-6d511b85238d', 'type': 'job_template', 'uuid': '62caf2a4-6ceb-4097-a39b-f3995282dc78'} 02/10/2025 01:57:01.313 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'oper': 'UPDATE', 'request-id': 'req-0206fc73-cc57-41af-8b87-968aa924c8a1', 'type': 'job_template', 'uuid': 'c31ea1aa-3e83-4dd8-9eaa-9f5d3f2c2195'} 02/10/2025 01:57:01.374 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'oper': 'UPDATE', 'request-id': 'req-afbd35f9-66bf-4789-815a-14d393176e2f', 'type': 'job_template', 'uuid': '6c93319d-38fb-4732-89d1-0070a00025d7'} 02/10/2025 01:57:01.382 7fe241f29438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a41b2d0-25a2-4b12-b732-83de69e8e7df object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.17:8082/global-vrouter-config/1a41b2d0-25a2-4b12-b732-83de69e8e7df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "1a41b2d0-25a2-4b12-b732-83de69e8e7df", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.393 7fe241f3ae10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b126c17-21d9-4423-b299-1a3ee2640136 object_type = job_template identifier_name = default-global-system-config:show_interface_details_template url = http://10.0.0.17:8082/job-template/1b126c17-21d9-4423-b299-1a3ee2640136 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "1b126c17-21d9-4423-b299-1a3ee2640136", "fq_name": ["default-global-system-config", "show_interface_details_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"interface_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Interface Details\", \"type\": \"object\", \"properties\": {\"interface_type\": {\"type\": \"string\", \"title\": \"Interface Type\", \"enum\": [\"physical\", \"logical\"], \"default\": \"physical\"}}, \"required\": [\"interface_type\"]}, \"conditional\": {\"title\": \"Sub Operation Type\", \"$ref\": \"#/definitions/sub_command\"}}, \"definitions\": {\"sub_command\": {\"title\": \"Sub Operation Type\", \"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"Show runtime interfaces\", \"Show configured interfaces\", \"Show interfaces by names\"], \"default\": \"Show runtime interfaces\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"Show runtime interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show configured interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show interfaces by names\"]}, \"interface_names\": {\"$id\": \"/properties/interface_names\", \"title\": \"Interface Names\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_names/items\", \"type\": \"string\", \"pattern\": \"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$\", \"title\": \"Interface Name\"}, \"examples\": [\"ge-0/0/1\", \"xe-0/0/0\"]}}, \"required\": [\"interface_names\"]}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show Interface Details Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces details sub-command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"oneOf\": [{\"properties\": {\"interface_stats_rt_phy\": {\"type\": \"array\", \"title\": \"Runtime Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"op_status\": {\"type\": \"string\", \"title\": \"Operational Status\", \"description\": \"Operational status of the interface\"}, \"admin_status\": {\"type\": \"string\", \"title\": \"Admin Status\", \"description\": \"Admin status of the interface\"}, \"input_rate\": {\"type\": \"string\", \"title\": \"InputRate (bps)\", \"description\": \"Input packets rate in bits per second if present\"}, \"output_rate\": {\"type\": \"string\", \"title\": \"OutputRate (bps)\", \"description\": \"Output packets rate in bits per second if present\"}}}}}}, {\"properties\": {\"interface_stats_log\": {\"type\": \"array\", \"title\": \"Logical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"address_family\": {\"type\": \"string\", \"title\": \"Address Family\", \"description\": \"Address family if present\"}}}}}}, {\"properties\": {\"interface_stats_cf_phy\": {\"type\": \"array\", \"title\": \"Configured Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}}}}}}]}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to get a list of physical or logical interfaces from a device and interfaces' other related information.", "display_name": "Show Interface Details"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.438 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-db1a9c44-9c89-45a3-b105-c76ff9622c95', 'type': 'global_vrouter_config', 'uuid': '1a41b2d0-25a2-4b12-b732-83de69e8e7df'} 02/10/2025 01:57:01.505 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'oper': 'UPDATE', 'request-id': 'req-08172c1c-080a-4b5f-95b2-52bfdc3f44c1', 'type': 'job_template', 'uuid': '1b126c17-21d9-4423-b299-1a3ee2640136'} 02/10/2025 01:57:01.543 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_config_template'], 'oper': 'UPDATE', 'request-id': 'req-5e7f5030-fb63-4e0b-bc43-fd5e4288db31', 'type': 'job_template', 'uuid': '958b7a6c-1e14-4cf3-985f-4874c2e7091c'} 02/10/2025 01:57:01.649 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'oper': 'UPDATE', 'request-id': 'req-4cb18f7e-ef35-4991-8191-2775f157c7be', 'type': 'job_template', 'uuid': 'bbc19f11-b2b1-43c7-988e-c05a9780d143'} 02/10/2025 01:57:01.672 7fe241f12240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e2157fc1-3eed-473f-8849-d4ab551e757b object_type = job_template identifier_name = default-global-system-config:show_ops_info_template url = http://10.0.0.17:8082/job-template/e2157fc1-3eed-473f-8849-d4ab551e757b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "e2157fc1-3eed-473f-8849-d4ab551e757b", "fq_name": ["default-global-system-config", "show_ops_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ops_type\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Operations commands\", \"type\": \"array\", \"minItems\": 1, \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"minProperties\": 1, \"additionalProperties\": false, \"properties\": {\"conditional\": {\"title\": \"Operation Command Type\", \"$ref\": \"#/definitions/sub_command\"}}}}}, \"definitions\": {\"sub_command\": {\"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"show chassis info\", \"show route info\", \"show bgp info\", \"show evpn info\", \"show lldp info\", \"show lacp info\", \"show vlan info\"], \"default\": \"show route info\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"show chassis info\"]}, \"command_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis alarms\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show route info\"]}, \"command_detail\": {\"$id\": \"/properties/route_detail\", \"title\": \"Route detail\", \"type\": \"string\", \"enum\": [\"route summary\"], \"default\": \"route summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show bgp info\"]}, \"command_detail\": {\"$id\": \"/properties/bgp_detail\", \"title\": \"BGP detail\", \"type\": \"string\", \"enum\": [\"bgp summary\", \"bgp neighbor\", \"bgp group\"], \"default\": \"bgp summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show evpn info\"]}, \"command_detail\": {\"$id\": \"/properties/evpn_detail\", \"title\": \"EVPN detail\", \"type\": \"string\", \"enum\": [\"evpn ip-prefix-database\", \"evpn instance extensive\", \"evpn instance designated-forwarder\", \"evpn instance backup-forwarder\", \"evpn database state default-gateway\"], \"default\": \"evpn ip-prefix-database\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lldp info\"]}, \"command_detail\": {\"$id\": \"/properties/lldp_detail\", \"title\": \"LLDP detail\", \"type\": \"string\", \"enum\": [\"lldp neighbors\"], \"default\": \"lldp neighbors\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lacp info\"]}, \"command_detail\": {\"$id\": \"/properties/lacp_detail\", \"title\": \"LACP detail\", \"type\": \"string\", \"enum\": [\"lacp interfaces extensive\", \"lacp statistics interfaces\"], \"default\": \"lacp interfaces extensive\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show vlan info\"]}, \"command_detail\": {\"$id\": \"/properties/vlan_detail\", \"title\": \"VLAN detail\", \"type\": \"string\", \"enum\": [\"vlans\"], \"default\": \"vlans\"}}}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display operational information", "display_name": "Show operations information"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.720 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'oper': 'UPDATE', 'request-id': 'req-e22799da-8ea5-4acd-9433-b5704a809f2a', 'type': 'job_template', 'uuid': 'e2157fc1-3eed-473f-8849-d4ab551e757b'} 02/10/2025 01:57:01.808 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'check_multicast_template'], 'oper': 'UPDATE', 'request-id': 'req-9297e7f3-fc09-4d46-8b71-bab731b7040b', 'type': 'job_template', 'uuid': 'e12fa279-cc69-47ab-ab53-90bee075921b'} 02/10/2025 01:57:01.852 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'oper': 'UPDATE', 'request-id': 'req-279e10e2-33b6-42d4-8728-ab269bf4c720', 'type': 'job_template', 'uuid': '41ed9d8b-c982-4f8f-a52b-7200ef541a61'} 02/10/2025 01:57:01.873 7fe2315bc780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 231dcd29-878d-4e62-823d-36de65a89b61 object_type = job_template identifier_name = default-global-system-config:vcenter_import_template url = http://10.0.0.17:8082/job-template/231dcd29-878d-4e62-823d-36de65a89b61 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "231dcd29-878d-4e62-823d-36de65a89b61", "fq_name": ["default-global-system-config", "vcenter_import_template"], "parent_type": "global-system-config", "job_template_type": "executable", "job_template_concurrency_level": "fabric", "job_template_executables": {"executable_info": [{"executable_path": "/opt/contrail/utils/vcenter-import", "executable_args": "", "job_completion_weightage": 100}]}, "job_template_input_schema": "{\"title\": \"vCenter Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"contrail_command\": {\"$id\": \"/properties/contrail_command\", \"description\": \"The Contrail Command details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/contrail_command/username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/contrail_command/password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/contrail_command/host\", \"description\": \"The Contrail Command IP and/or port\", \"type\": \"string\"}}}, \"vcenter\": {\"$id\": \"/properties/vcenter\", \"description\": \"vCenter details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/vcenter/username\", \"description\": \"Username of vCenter Server\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/vcenter/password\", \"description\": \"Password of vCenter Server\", \"type\": \"string\"}, \"datacenter\": {\"$id\": \"/properties/vcenter/datacenter\", \"description\": \"vCenter DataCenter name to Import ESXi Hosts\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/vcenter/host\", \"description\": \"vCenter Hostname/IP-Address including port\", \"type\": \"string\"}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "VCenter Import"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.904 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'oper': 'UPDATE', 'request-id': 'req-274fc0bc-77e6-40cd-a14f-bc04257f8f5c', 'type': 'job_template', 'uuid': '231dcd29-878d-4e62-823d-36de65a89b61'} 02/10/2025 01:57:01.937 7fe23143b4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.12 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:01.968 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'oper': 'UPDATE', 'request-id': 'req-cb28618e-a63d-4f6d-a1ea-48a51c025523', 'type': 'job_template', 'uuid': '8c0c5ccf-7da8-4933-8a0f-ea31ff1524b1'} 02/10/2025 01:57:02.019 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'oper': 'UPDATE', 'request-id': 'req-d0c0c4ff-c0a0-4137-bc86-6e08d18b7c66', 'type': 'job_template', 'uuid': '6307e6df-fe2e-44fd-8ee8-7dfe91ee15ff'} 02/10/2025 01:57:02.041 7fe231254ac8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3098b7f5-e3d1-49d2-a581-45cf3e7b84de object_type = job_template identifier_name = default-global-system-config:node_profile_template url = http://10.0.0.17:8082/job-template/3098b7f5-e3d1-49d2-a581-45cf3e7b84de operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "3098b7f5-e3d1-49d2-a581-45cf3e7b84de", "fq_name": ["default-global-system-config", "node_profile_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/node_profile.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Node Profile Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command Hostname/IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Node Profile"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.042 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-90e0f636-62a2-42e2-86da-a91575cf354e', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 01:57:02.090 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'oper': 'UPDATE', 'request-id': 'req-eb4d705c-fd38-4f97-b529-358adc97089e', 'type': 'job_template', 'uuid': '3098b7f5-e3d1-49d2-a581-45cf3e7b84de'} 02/10/2025 01:57:02.147 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'oper': 'UPDATE', 'request-id': 'req-f6a5277a-eb76-42e8-9cd8-6130bf166e20', 'type': 'job_template', 'uuid': 'e0e2365a-9817-4070-8ba8-00aa68aea4d5'} 02/10/2025 01:57:02.198 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'oper': 'UPDATE', 'request-id': 'req-a6949503-a5c6-42e9-b5ea-d93f75fc8de8', 'type': 'job_template', 'uuid': '49536aad-7570-4d5f-b370-d76cd441cab9'} 02/10/2025 01:57:02.224 7fe2313cc240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2cec02bf-6783-482f-9107-57a8f89a563f object_type = job_template identifier_name = default-global-system-config:show_chassis_info_template url = http://10.0.0.17:8082/job-template/2cec02bf-6783-482f-9107-57a8f89a563f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": "2cec02bf-6783-482f-9107-57a8f89a563f", "fq_name": ["default-global-system-config", "show_chassis_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"chassis\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Chassis information\", \"type\": \"object\", \"properties\": {\"chassis_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis hardware\"}}, \"required\": [\"chassis_detail\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display chassis information", "display_name": "Show chassis information"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.250 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'oper': 'UPDATE', 'request-id': 'req-7e487444-a747-480f-8f00-260aee3d1e3c', 'type': 'job_template', 'uuid': '2cec02bf-6783-482f-9107-57a8f89a563f'} 02/10/2025 01:57:02.293 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'oper': 'UPDATE', 'request-id': 'req-07ecaf6e-09d6-4db3-a593-2f39882321fb', 'type': 'job_template', 'uuid': '9a18ba05-85e8-4e36-9b55-8b7ef75d0ad0'} 02/10/2025 01:57:02.333 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'oper': 'UPDATE', 'request-id': 'req-5b1da0b1-8f23-404f-b9db-d9db6733d9d7', 'type': 'config_properties', 'uuid': 'b7c1250d-528f-4fe8-9ca2-fa46235752aa'} 02/10/2025 01:57:02.506 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-6bd177c0-0d95-4ce1-b264-820e37834dcc', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 01:57:02.568 7fe241f2fb70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3915a02a-6698-481d-91c4-4ed56a0071eb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.17:8082/global-system-config/3915a02a-6698-481d-91c4-4ed56a0071eb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "3915a02a-6698-481d-91c4-4ed56a0071eb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.587 7fe2311f2828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 32587d65-3efa-42bd-b062-ef34090e1438 object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = http://10.0.0.17:8082/hardware/32587d65-3efa-42bd-b062-ef34090e1438 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "32587d65-3efa-42bd-b062-ef34090e1438", "fq_name": ["juniper-qfx5100-48sh-afi"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.617 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'oper': 'UPDATE', 'request-id': 'req-bf62b17a-3bf8-42c2-9d25-5046fa997989', 'type': 'hardware', 'uuid': '32587d65-3efa-42bd-b062-ef34090e1438'} 02/10/2025 01:57:02.628 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-66305665-a8b2-4baf-bb67-bedfb2e2087d', 'type': 'global_system_config', 'uuid': '3915a02a-6698-481d-91c4-4ed56a0071eb'} 02/10/2025 01:57:02.709 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'oper': 'UPDATE', 'request-id': 'req-eeb38d14-64dd-49e4-b17a-84d828a83c72', 'type': 'hardware', 'uuid': '5d39ff29-8bb7-4834-b38f-d5e2cee6b4ae'} 02/10/2025 01:57:02.745 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'oper': 'UPDATE', 'request-id': 'req-ee6b431f-e8bf-466d-9c17-142550971f33', 'type': 'hardware', 'uuid': '7bf81894-381b-4923-ac5c-bf701c94471a'} 02/10/2025 01:57:02.761 7fe241ede438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = da0ae661-a375-4970-aa8a-1cf0ab4d5c59 object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = http://10.0.0.17:8082/hardware/da0ae661-a375-4970-aa8a-1cf0ab4d5c59 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "da0ae661-a375-4970-aa8a-1cf0ab4d5c59", "fq_name": ["juniper-qfx5100-48th-afo"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.782 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'oper': 'UPDATE', 'request-id': 'req-ac4388c3-ef08-4de6-b5bf-afd5528f985e', 'type': 'hardware', 'uuid': 'da0ae661-a375-4970-aa8a-1cf0ab4d5c59'} 02/10/2025 01:57:02.816 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'oper': 'UPDATE', 'request-id': 'req-e4b67701-5276-43e8-b20c-8963d63cdfa1', 'type': 'hardware', 'uuid': 'e32bfd1b-fd15-44ff-886f-365513ea0eb6'} 02/10/2025 01:57:02.850 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'oper': 'UPDATE', 'request-id': 'req-aeb0f61a-3bfa-480f-86cd-792e21e1b150', 'type': 'hardware', 'uuid': '443b600e-6ead-42bf-8729-341f532b8d91'} 02/10/2025 01:57:02.913 7fe2312fb780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f1f11ed8-0f22-4fa4-a6f8-bc03515f3908 object_type = hardware identifier_name = juniper-qfx5100-48t url = http://10.0.0.17:8082/hardware/f1f11ed8-0f22-4fa4-a6f8-bc03515f3908 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "f1f11ed8-0f22-4fa4-a6f8-bc03515f3908", "fq_name": ["juniper-qfx5100-48t"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:02.930 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'oper': 'UPDATE', 'request-id': 'req-e5e2b66a-6fde-42c5-af98-bc5d672a5a49', 'type': 'hardware', 'uuid': 'f1f11ed8-0f22-4fa4-a6f8-bc03515f3908'} 02/10/2025 01:57:02.962 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'oper': 'UPDATE', 'request-id': 'req-b5eea345-3230-4b73-aaa3-0fcc7a3ebf10', 'type': 'hardware', 'uuid': '4c79674b-ef61-4b24-934a-597add7cd89f'} 02/10/2025 01:57:03.030 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'oper': 'UPDATE', 'request-id': 'req-d00500b5-ca91-4490-8166-1de461b527db', 'type': 'hardware', 'uuid': 'cf2885f4-bcdb-4d51-a9a9-ec35454ca751'} 02/10/2025 01:57:03.093 7fe241f2c588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9d3d9898-910e-45f2-98e1-d86b4c1828aa object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = http://10.0.0.17:8082/hardware/9d3d9898-910e-45f2-98e1-d86b4c1828aa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "9d3d9898-910e-45f2-98e1-d86b4c1828aa", "fq_name": ["juniper-qfx5100-24q-aa"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:03.110 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'oper': 'UPDATE', 'request-id': 'req-7068d4a6-3e91-47ef-8500-9216375eb42e', 'type': 'hardware', 'uuid': '9d3d9898-910e-45f2-98e1-d86b4c1828aa'} 02/10/2025 01:57:03.143 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'oper': 'UPDATE', 'request-id': 'req-ec6391a1-41e9-49da-8448-0ff57ca550b7', 'type': 'hardware', 'uuid': '2560732e-ef87-4174-b21d-83b8a27ed585'} 02/10/2025 01:57:03.217 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'oper': 'UPDATE', 'request-id': 'req-df0f5603-ea5c-4ac5-8bde-6b6ea7f23c54', 'type': 'hardware', 'uuid': 'e3316c8b-e8e1-4be0-8f81-c1a2a4a84ca3'} 02/10/2025 01:57:03.274 7fe241ece8d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 86defe83-4305-489e-9e34-ac5f90e3204a object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = http://10.0.0.17:8082/hardware/86defe83-4305-489e-9e34-ac5f90e3204a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "86defe83-4305-489e-9e34-ac5f90e3204a", "fq_name": ["juniper-qfx5100e-48t-6q"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:03.292 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'oper': 'UPDATE', 'request-id': 'req-e1865b55-61d6-4a69-b1a1-c950aecd372f', 'type': 'hardware', 'uuid': '86defe83-4305-489e-9e34-ac5f90e3204a'} 02/10/2025 01:57:03.320 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'oper': 'UPDATE', 'request-id': 'req-24c5085c-1357-47f5-b98b-a695754dacce', 'type': 'hardware', 'uuid': '653b24c4-56c0-4038-be57-75c5bd71c736'} 02/10/2025 01:57:03.387 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'oper': 'UPDATE', 'request-id': 'req-ccb146be-2e48-4fb7-b79c-41d6da9aeaa6', 'type': 'hardware', 'uuid': 'dbb1cc09-1504-41c6-b00c-d83ef4cfa1a1'} 02/10/2025 01:57:03.449 7fe23142b048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b68f5182-e1a5-4cd9-b42c-721cf328e372 object_type = hardware identifier_name = juniper-qfx5110-32q url = http://10.0.0.17:8082/hardware/b68f5182-e1a5-4cd9-b42c-721cf328e372 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "b68f5182-e1a5-4cd9-b42c-721cf328e372", "fq_name": ["juniper-qfx5110-32q"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:03.464 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'oper': 'UPDATE', 'request-id': 'req-84a37acc-9609-462c-b5f4-b666c3cf5dfb', 'type': 'hardware', 'uuid': 'b68f5182-e1a5-4cd9-b42c-721cf328e372'} 02/10/2025 01:57:03.494 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'oper': 'UPDATE', 'request-id': 'req-9673e6f6-4fb9-44fc-aca0-eb45c19ef614', 'type': 'hardware', 'uuid': 'c02dc563-2636-4ab4-a7c5-d70ec8d52123'} 02/10/2025 01:57:03.572 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'oper': 'UPDATE', 'request-id': 'req-ddd02e5a-28d9-4e12-964e-6d5962d94360', 'type': 'hardware', 'uuid': '9b69469f-7e23-45d7-89b0-f63fbdb24378'} 02/10/2025 01:57:03.630 7fe23142e198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e2f0f962-ed50-4bb6-b946-533012c448b4 object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = http://10.0.0.17:8082/hardware/e2f0f962-ed50-4bb6-b946-533012c448b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "e2f0f962-ed50-4bb6-b946-533012c448b4", "fq_name": ["juniper-qfx5120-48t-6c"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:03.653 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'oper': 'UPDATE', 'request-id': 'req-66442f27-ec53-4a69-a73c-cf9bc5961a7a', 'type': 'hardware', 'uuid': 'e2f0f962-ed50-4bb6-b946-533012c448b4'} 02/10/2025 01:57:03.686 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'oper': 'UPDATE', 'request-id': 'req-db560fc9-47d3-4030-87c9-19fcac69866c', 'type': 'hardware', 'uuid': '4a043a97-e6f7-4a3d-864f-6da03e18353d'} 02/10/2025 01:57:03.772 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'oper': 'UPDATE', 'request-id': 'req-23366d04-7682-4fee-9a77-362f89ad1def', 'type': 'hardware', 'uuid': 'ed73d4d0-afbf-439c-80e0-3b6bcb85fe7e'} 02/10/2025 01:57:03.790 7fe231590f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a92ac443-224f-4f90-a605-200ec5eb15b3 object_type = hardware identifier_name = juniper-qfx5200-32c-32q url = http://10.0.0.17:8082/hardware/a92ac443-224f-4f90-a605-200ec5eb15b3 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "a92ac443-224f-4f90-a605-200ec5eb15b3", "fq_name": ["juniper-qfx5200-32c-32q"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:03.816 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'oper': 'UPDATE', 'request-id': 'req-6b3c0440-b270-40c1-ae62-843f53dfc41f', 'type': 'hardware', 'uuid': 'a92ac443-224f-4f90-a605-200ec5eb15b3'} 02/10/2025 01:57:03.884 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'oper': 'UPDATE', 'request-id': 'req-7e32f1db-2be5-4a00-b27d-4a54ed17e224', 'type': 'hardware', 'uuid': '5538f1c9-f6ad-4a8a-beab-21841ad0cd37'} 02/10/2025 01:57:03.965 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'oper': 'UPDATE', 'request-id': 'req-4b5a8813-a31f-463a-8b2e-74f973bc8aff', 'type': 'hardware', 'uuid': '40dae0c1-8102-4589-9be4-7edabae59c73'} 02/10/2025 01:57:03.990 7fe241ee7588 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bbcc15d1-4110-42a0-afca-109d76cf724c object_type = hardware identifier_name = juniper-qfx10002-72q url = http://10.0.0.17:8082/hardware/bbcc15d1-4110-42a0-afca-109d76cf724c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "bbcc15d1-4110-42a0-afca-109d76cf724c", "fq_name": ["juniper-qfx10002-72q"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.009 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'oper': 'UPDATE', 'request-id': 'req-08e53e01-5fce-40f0-bb05-80a4f2ab880d', 'type': 'hardware', 'uuid': 'bbcc15d1-4110-42a0-afca-109d76cf724c'} 02/10/2025 01:57:04.046 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'oper': 'UPDATE', 'request-id': 'req-eec59625-e6fb-4104-824c-62844622b155', 'type': 'hardware', 'uuid': 'fec0971e-84f3-4d16-9d09-4e89cfbe93c4'} 02/10/2025 01:57:04.087 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'oper': 'UPDATE', 'request-id': 'req-4ffdea00-b545-489d-bc29-34b5da2e27e1', 'type': 'hardware', 'uuid': '6471710f-a16f-4404-9b58-026359f0c001'} 02/10/2025 01:57:04.105 7fe23142e048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 540215d0-e3cf-47a6-9b18-85a2f5b3e229 object_type = hardware identifier_name = juniper-qfx10016 url = http://10.0.0.17:8082/hardware/540215d0-e3cf-47a6-9b18-85a2f5b3e229 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "540215d0-e3cf-47a6-9b18-85a2f5b3e229", "fq_name": ["juniper-qfx10016"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.138 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10016'], 'oper': 'UPDATE', 'request-id': 'req-3ec965ca-3e81-4094-ba5e-cd02ee958772', 'type': 'hardware', 'uuid': '540215d0-e3cf-47a6-9b18-85a2f5b3e229'} 02/10/2025 01:57:04.172 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10008'], 'oper': 'UPDATE', 'request-id': 'req-8a07525b-fee8-45d6-898f-b7d884ad32b3', 'type': 'hardware', 'uuid': 'd08a33cf-fcb9-4b75-a232-0c74f6de5c0f'} 02/10/2025 01:57:04.220 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'oper': 'UPDATE', 'request-id': 'req-1f9eba5a-873d-4eec-b8c9-6327a0498b30', 'type': 'hardware', 'uuid': '4125245c-04af-4b92-bd1e-1848e69c37fa'} 02/10/2025 01:57:04.277 7fe231314cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1868fce6-1714-4311-ac59-6fc8779e1f59 object_type = hardware identifier_name = juniper-mx80 url = http://10.0.0.17:8082/hardware/1868fce6-1714-4311-ac59-6fc8779e1f59 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "1868fce6-1714-4311-ac59-6fc8779e1f59", "fq_name": ["juniper-mx80"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.294 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80'], 'oper': 'UPDATE', 'request-id': 'req-150d0679-af92-422c-b0ff-054fb31507a5', 'type': 'hardware', 'uuid': '1868fce6-1714-4311-ac59-6fc8779e1f59'} 02/10/2025 01:57:04.367 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'oper': 'UPDATE', 'request-id': 'req-dd2b4376-9de8-43b7-898b-32dcad91ab0c', 'type': 'hardware', 'uuid': 'f4fb030f-f7ef-42ce-a167-ac05b234dcd7'} 02/10/2025 01:57:04.400 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx204'], 'oper': 'UPDATE', 'request-id': 'req-a8af8a35-a486-49f4-8479-762cdc7a59b3', 'type': 'hardware', 'uuid': '3023cc1a-b664-42e3-a638-9c7ab830a556'} 02/10/2025 01:57:04.455 7fe2313128d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 041e3b2b-c01c-4b1b-8085-44d76d01de9b object_type = hardware identifier_name = juniper-mx240 url = http://10.0.0.17:8082/hardware/041e3b2b-c01c-4b1b-8085-44d76d01de9b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "041e3b2b-c01c-4b1b-8085-44d76d01de9b", "fq_name": ["juniper-mx240"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.473 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx240'], 'oper': 'UPDATE', 'request-id': 'req-2996a543-c0ea-4805-b215-92f814594c8b', 'type': 'hardware', 'uuid': '041e3b2b-c01c-4b1b-8085-44d76d01de9b'} 02/10/2025 01:57:04.554 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx480'], 'oper': 'UPDATE', 'request-id': 'req-cdf11a45-9193-47ba-bdbd-01c86808ecc5', 'type': 'hardware', 'uuid': '7f8e9f1e-7609-4cae-af59-90a8f4a2204a'} 02/10/2025 01:57:04.581 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx960'], 'oper': 'UPDATE', 'request-id': 'req-09aab199-a397-43c1-a5b4-f89324eb0ffb', 'type': 'hardware', 'uuid': '668ee6ae-4160-4ff3-82ab-31886835c432'} 02/10/2025 01:57:04.641 7fe241f29b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 47b17514-c641-471d-9d29-2634991f98f6 object_type = hardware identifier_name = juniper-mx2008 url = http://10.0.0.17:8082/hardware/47b17514-c641-471d-9d29-2634991f98f6 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "47b17514-c641-471d-9d29-2634991f98f6", "fq_name": ["juniper-mx2008"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.657 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2008'], 'oper': 'UPDATE', 'request-id': 'req-ab3abdb0-5cbb-410e-8b09-fbb5a0d8448e', 'type': 'hardware', 'uuid': '47b17514-c641-471d-9d29-2634991f98f6'} 02/10/2025 01:57:04.691 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2010'], 'oper': 'UPDATE', 'request-id': 'req-58acbeb5-5619-468f-9380-8767d530e446', 'type': 'hardware', 'uuid': '2b03e57f-9663-4713-aaaa-a70e02242b38'} 02/10/2025 01:57:04.773 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2020'], 'oper': 'UPDATE', 'request-id': 'req-309f6e70-cce9-4fe0-b427-3c203529af6f', 'type': 'hardware', 'uuid': '2d238dae-af06-4b03-b7ae-c090778bb8a9'} 02/10/2025 01:57:04.789 7fe232df28d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c338f138-721c-41a4-a6b8-7fcee02a9a2a object_type = hardware identifier_name = juniper-mx10003 url = http://10.0.0.17:8082/hardware/c338f138-721c-41a4-a6b8-7fcee02a9a2a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "c338f138-721c-41a4-a6b8-7fcee02a9a2a", "fq_name": ["juniper-mx10003"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.820 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx10003'], 'oper': 'UPDATE', 'request-id': 'req-50fdb787-130a-45fe-a3fe-c1c8da32e26f', 'type': 'hardware', 'uuid': 'c338f138-721c-41a4-a6b8-7fcee02a9a2a'} 02/10/2025 01:57:04.847 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10008'], 'oper': 'UPDATE', 'request-id': 'req-6ed82e0f-7881-41a1-a0af-55f800e2858b', 'type': 'hardware', 'uuid': '7da56b32-4ef7-4bba-9a4a-6bb619b6aedb'} 02/10/2025 01:57:04.926 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10016'], 'oper': 'UPDATE', 'request-id': 'req-bc23b18a-121d-4e37-9d8a-9b0b0c47d8d0', 'type': 'hardware', 'uuid': 'f6b5d276-5ee5-4529-9788-63e21300ee36'} 02/10/2025 01:57:04.945 7fe2311c9e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9f745f0b-5b2e-49b0-aa28-a2b34217a8b1 object_type = hardware identifier_name = juniper-vmx url = http://10.0.0.17:8082/hardware/9f745f0b-5b2e-49b0-aa28-a2b34217a8b1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "9f745f0b-5b2e-49b0-aa28-a2b34217a8b1", "fq_name": ["juniper-vmx"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:04.972 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vmx'], 'oper': 'UPDATE', 'request-id': 'req-9905135c-bf6f-48ac-a9e7-bd4048b42d9b', 'type': 'hardware', 'uuid': '9f745f0b-5b2e-49b0-aa28-a2b34217a8b1'} 02/10/2025 01:57:05.055 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5400'], 'oper': 'UPDATE', 'request-id': 'req-d4e002be-c5de-423a-8947-ac90a72a9173', 'type': 'hardware', 'uuid': '60faa294-2556-446b-83cb-7fb8244a64a6'} 02/10/2025 01:57:05.128 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5600'], 'oper': 'UPDATE', 'request-id': 'req-f2da7d00-faf0-4918-85c9-2e18245c924e', 'type': 'hardware', 'uuid': '59e5c910-d9c7-42a1-8dec-c1db10c4ab28'} 02/10/2025 01:57:05.146 7fe23122a828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f027d32e-2929-45db-bc44-69ff9bc58bbf object_type = hardware identifier_name = juniper-srx4600 url = http://10.0.0.17:8082/hardware/f027d32e-2929-45db-bc44-69ff9bc58bbf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "f027d32e-2929-45db-bc44-69ff9bc58bbf", "fq_name": ["juniper-srx4600"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:05.173 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4600'], 'oper': 'UPDATE', 'request-id': 'req-1b8754a1-8947-4483-940c-bda8505c383e', 'type': 'hardware', 'uuid': 'f027d32e-2929-45db-bc44-69ff9bc58bbf'} 02/10/2025 01:57:05.249 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4100'], 'oper': 'UPDATE', 'request-id': 'req-979ada62-2c38-49eb-8747-baa599706c22', 'type': 'hardware', 'uuid': 'a1cc4087-00eb-4883-b49e-5a9aac65999c'} 02/10/2025 01:57:05.330 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx1500'], 'oper': 'UPDATE', 'request-id': 'req-55f343e3-18fa-4006-8009-626897a96290', 'type': 'hardware', 'uuid': 'c8c83b55-ea84-409a-900d-d8c620e55842'} 02/10/2025 01:57:05.369 7fe2311e3d68 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9f16403c-bde9-461d-b1bf-302851d8956b object_type = hardware identifier_name = juniper-srx240h-poe url = http://10.0.0.17:8082/hardware/9f16403c-bde9-461d-b1bf-302851d8956b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "9f16403c-bde9-461d-b1bf-302851d8956b", "fq_name": ["juniper-srx240h-poe"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:05.385 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'oper': 'UPDATE', 'request-id': 'req-6faa4b2e-9ec1-4087-986b-431491bb0c7e', 'type': 'hardware', 'uuid': '9f16403c-bde9-461d-b1bf-302851d8956b'} 02/10/2025 01:57:05.417 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5800'], 'oper': 'UPDATE', 'request-id': 'req-e2ff26b6-fb81-49ae-99d9-a830888ecc19', 'type': 'hardware', 'uuid': '05cb61db-c439-46ce-b12c-ce02ed9404fa'} 02/10/2025 01:57:05.453 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4200'], 'oper': 'UPDATE', 'request-id': 'req-bac5fa61-61da-457a-a8bd-fe5c0c9480fe', 'type': 'hardware', 'uuid': '0f32693e-8506-4914-81e0-c863ea67ff04'} 02/10/2025 01:57:05.513 7fe23122f240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 67d92472-9871-458b-a762-f10b66a2ae07 object_type = hardware identifier_name = juniper-vsrx url = http://10.0.0.17:8082/hardware/67d92472-9871-458b-a762-f10b66a2ae07 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": "67d92472-9871-458b-a762-f10b66a2ae07", "fq_name": ["juniper-vsrx"]}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:05.536 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vsrx'], 'oper': 'UPDATE', 'request-id': 'req-8ff712e4-c2e3-48f4-90a1-4a0e3ce31a29', 'type': 'hardware', 'uuid': '67d92472-9871-458b-a762-f10b66a2ae07'} 02/10/2025 01:57:05.575 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'oper': 'UPDATE', 'request-id': 'req-04289935-a53d-4b46-a117-1fa0afbc1736', 'type': 'feature', 'uuid': '81e1e0aa-aa0a-4554-95cd-19f8c15ff69f'} 02/10/2025 01:57:05.646 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'oper': 'UPDATE', 'request-id': 'req-538a52cf-530a-41e4-85df-45cf48d18ca0', 'type': 'feature', 'uuid': '510bbd59-398c-40cd-be3a-ba646f665887'} 02/10/2025 01:57:05.665 7fe2315b4438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a48c1391-b7fe-4fe7-8b18-0358c510fcdd object_type = feature identifier_name = default-global-system-config:l2-gateway url = http://10.0.0.17:8082/feature/a48c1391-b7fe-4fe7-8b18-0358c510fcdd operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": "a48c1391-b7fe-4fe7-8b18-0358c510fcdd", "fq_name": ["default-global-system-config", "l2-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:05.698 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'oper': 'UPDATE', 'request-id': 'req-3624a420-74d8-412a-84a8-f81a289d3353', 'type': 'feature', 'uuid': 'a48c1391-b7fe-4fe7-8b18-0358c510fcdd'} 02/10/2025 01:57:05.767 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'oper': 'UPDATE', 'request-id': 'req-c8d8dbe4-d032-40e6-a02a-a0c73adb01ce', 'type': 'feature', 'uuid': '8caa391f-2d69-4500-832c-da5247993822'} 02/10/2025 01:57:05.847 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'oper': 'UPDATE', 'request-id': 'req-3b9949c6-4bb0-42d1-a938-45e1e9f48307', 'type': 'feature', 'uuid': '21819f6c-5f1f-4163-87a3-585cf420a852'} 02/10/2025 01:57:05.865 7fe2311e3828 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35207334-181e-4371-8220-e30dd1275441 object_type = feature identifier_name = default-global-system-config:dc-gateway url = http://10.0.0.17:8082/feature/35207334-181e-4371-8220-e30dd1275441 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": "35207334-181e-4371-8220-e30dd1275441", "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:05.887 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'oper': 'UPDATE', 'request-id': 'req-3be6f426-c48d-438f-9f28-1dffba409d2c', 'type': 'feature', 'uuid': '35207334-181e-4371-8220-e30dd1275441'} 02/10/2025 01:57:05.967 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-b56cae2f-4473-4247-8810-b4dda2c1c2eb', 'type': 'feature', 'uuid': '24d85dac-18b8-4736-ad06-8094b5cb173b'} 02/10/2025 01:57:06.041 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'oper': 'UPDATE', 'request-id': 'req-b1eb5950-21b7-495f-99db-f5b6400651be', 'type': 'feature', 'uuid': 'f644b185-63fe-49bf-8d14-43174e633ef4'} 02/10/2025 01:57:06.063 7fe231359f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 20a06f57-b655-446c-9c00-b59cb32130df object_type = feature identifier_name = default-global-system-config:telemetry url = http://10.0.0.17:8082/feature/20a06f57-b655-446c-9c00-b59cb32130df operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": "20a06f57-b655-446c-9c00-b59cb32130df", "fq_name": ["default-global-system-config", "telemetry"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.079 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'oper': 'UPDATE', 'request-id': 'req-083111ed-1ff3-4182-8122-3afff642a8a5', 'type': 'feature', 'uuid': '20a06f57-b655-446c-9c00-b59cb32130df'} 02/10/2025 01:57:06.112 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'oper': 'UPDATE', 'request-id': 'req-166cfb45-85c1-43f0-910b-3f556e20a02e', 'type': 'feature', 'uuid': 'f1f7c841-e5aa-49a0-8d06-13f0fb0951f6'} 02/10/2025 01:57:06.185 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'oper': 'UPDATE', 'request-id': 'req-a83753f8-83db-4034-af76-229475fdf721', 'type': 'feature', 'uuid': 'f2edb98f-1255-4a16-ba26-4dedcfc24e00'} 02/10/2025 01:57:06.241 7fe2311f7978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ab4525f8-0555-4800-aa89-5f21f5e535cf object_type = feature identifier_name = default-global-system-config:pnf-service-chaining url = http://10.0.0.17:8082/feature/ab4525f8-0555-4800-aa89-5f21f5e535cf operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": "ab4525f8-0555-4800-aa89-5f21f5e535cf", "fq_name": ["default-global-system-config", "pnf-service-chaining"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.266 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'oper': 'UPDATE', 'request-id': 'req-ec6da1a7-778e-411b-a173-df07d0431607', 'type': 'feature', 'uuid': 'ab4525f8-0555-4800-aa89-5f21f5e535cf'} 02/10/2025 01:57:06.308 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'oper': 'UPDATE', 'request-id': 'req-caf7c43a-53dc-4769-a559-9566df2889b0', 'type': 'physical_role', 'uuid': 'fec1e380-e237-44c9-9be9-6c7a897ba591'} 02/10/2025 01:57:06.342 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'oper': 'UPDATE', 'request-id': 'req-428fa130-1fbd-41a1-8e67-684c24ae33f0', 'type': 'physical_role', 'uuid': 'c0016db2-fd32-46fa-af6d-f9721fdb89d5'} 02/10/2025 01:57:06.360 7fe23130e0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd105f80-be40-49cd-8090-768d07770dc2 object_type = physical_role identifier_name = default-global-system-config:superspine url = http://10.0.0.17:8082/physical-role/fd105f80-be40-49cd-8090-768d07770dc2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": "fd105f80-be40-49cd-8090-768d07770dc2", "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.375 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'oper': 'UPDATE', 'request-id': 'req-f6ad18e3-f39b-4e29-ad3d-81c9cdbb628f', 'type': 'physical_role', 'uuid': 'fd105f80-be40-49cd-8090-768d07770dc2'} 02/10/2025 01:57:06.445 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'oper': 'UPDATE', 'request-id': 'req-1bb1b469-084b-4b3a-80c9-37d00a36a5b2', 'type': 'physical_role', 'uuid': 'c70176a5-8e0e-4e3f-8472-06757962bd3e'} 02/10/2025 01:57:06.493 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-43cbccf7-6de7-4103-ade4-4408a3734208', 'type': 'overlay_role', 'uuid': 'a17f104f-6a3d-42de-87db-b77306122814'} 02/10/2025 01:57:06.548 7fe231423978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d6f42d0a-8fc3-4350-9a64-6215239acb04 object_type = overlay_role identifier_name = default-global-system-config:crb-access url = http://10.0.0.17:8082/overlay-role/d6f42d0a-8fc3-4350-9a64-6215239acb04 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "d6f42d0a-8fc3-4350-9a64-6215239acb04", "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.568 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'oper': 'UPDATE', 'request-id': 'req-05b46683-85d6-4526-9da6-dd1fc7771f40', 'type': 'overlay_role', 'uuid': 'd6f42d0a-8fc3-4350-9a64-6215239acb04'} 02/10/2025 01:57:06.647 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-b9c4600e-ea4f-43cb-8186-6c832ee4e381', 'type': 'overlay_role', 'uuid': '1e77669b-a2f0-48fb-8178-5a0e61f0cfdb'} 02/10/2025 01:57:06.675 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'oper': 'UPDATE', 'request-id': 'req-7f9140e7-96c9-4b0a-b566-aa8303ebd19f', 'type': 'overlay_role', 'uuid': '7668039a-6b92-4d34-8a10-cbf44330d6e6'} 02/10/2025 01:57:06.732 7fe241f3a0f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 987a225c-ad03-49b1-b913-2fd61803a0fa object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = http://10.0.0.17:8082/overlay-role/987a225c-ad03-49b1-b913-2fd61803a0fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "987a225c-ad03-49b1-b913-2fd61803a0fa", "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.762 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-ca2f28c3-8d14-418d-8685-44f6921b7d7b', 'type': 'overlay_role', 'uuid': '987a225c-ad03-49b1-b913-2fd61803a0fa'} 02/10/2025 01:57:06.793 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-4c6e6608-f470-4fcc-88e0-7fc85a3ed270', 'type': 'overlay_role', 'uuid': '1e77669b-a2f0-48fb-8178-5a0e61f0cfdb'} 02/10/2025 01:57:06.863 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'oper': 'UPDATE', 'request-id': 'req-d3922f6a-7700-45be-bf36-63ed7f25163a', 'type': 'overlay_role', 'uuid': '92cda220-aeaf-47d2-bee6-c28666e85985'} 02/10/2025 01:57:06.879 7fe231288390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e2c93422-09d4-409e-b825-f2e71bd45d1b object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = http://10.0.0.17:8082/overlay-role/e2c93422-09d4-409e-b825-f2e71bd45d1b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "e2c93422-09d4-409e-b825-f2e71bd45d1b", "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:06.894 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'oper': 'UPDATE', 'request-id': 'req-8bd0a9dd-370b-495b-a58e-7f213860f4bb', 'type': 'overlay_role', 'uuid': 'e2c93422-09d4-409e-b825-f2e71bd45d1b'} 02/10/2025 01:57:06.971 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'oper': 'UPDATE', 'request-id': 'req-b6764c3c-fb75-4074-8d13-732f8a67353b', 'type': 'overlay_role', 'uuid': 'f4d1a68b-8d36-4036-929a-b10a516e2128'} 02/10/2025 01:57:07.060 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'oper': 'UPDATE', 'request-id': 'req-8eb78245-8059-4bef-868e-cee5a166c8a3', 'type': 'overlay_role', 'uuid': '5ee11ede-c02d-4ce7-8259-0c3cb31576b6'} 02/10/2025 01:57:07.093 7fe23142e198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5cd463ce-9796-4a6f-9861-b552173afbd0 object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = http://10.0.0.17:8082/overlay-role/5cd463ce-9796-4a6f-9861-b552173afbd0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "5cd463ce-9796-4a6f-9861-b552173afbd0", "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.154 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'oper': 'UPDATE', 'request-id': 'req-6b0a6e78-f604-4297-8cd1-37262362e6e1', 'type': 'overlay_role', 'uuid': '5cd463ce-9796-4a6f-9861-b552173afbd0'} 02/10/2025 01:57:07.178 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'oper': 'UPDATE', 'request-id': 'req-457f8903-dd40-43ff-b447-454d972bf5d3', 'type': 'overlay_role', 'uuid': '1e68f7db-1588-4b1e-aaab-5268f2d7f0e7'} 02/10/2025 01:57:07.264 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'oper': 'UPDATE', 'request-id': 'req-de529332-116f-471d-913d-5ef63c090921', 'type': 'overlay_role', 'uuid': '6a06d18d-9e56-4f27-94df-83c24400cbde'} 02/10/2025 01:57:07.314 7fe241f276d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = bd9c524a-d1bb-4199-abb0-ec61484ad343 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = http://10.0.0.17:8082/role-definition/bd9c524a-d1bb-4199-abb0-ec61484ad343 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "bd9c524a-d1bb-4199-abb0-ec61484ad343", "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.359 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bb457cf7-0b93-43ac-8d8b-948f1b5cedb1', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:07.396 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cb3bac23-0c39-4a0f-861f-252e3ad38ab0', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:07.424 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-0a023958-fd71-4b66-9acd-321f251e2521', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:07.487 7fe241ece4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7651148d-f1e8-4cc7-9afe-10523a34969b object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = http://10.0.0.17:8082/role-definition/7651148d-f1e8-4cc7-9afe-10523a34969b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "7651148d-f1e8-4cc7-9afe-10523a34969b", "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.512 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7ef6c2c3-aa6e-456e-8989-0f401bb1620b', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:07.552 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c9dce1ca-2dac-46a2-8f5b-7f8a4b268b80', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:07.619 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-9041f236-8573-4323-b373-5c0e13deea0d', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:07.646 7fe231423780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5b89acc4-603f-4379-a9a4-1afaa1092bfc object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = http://10.0.0.17:8082/role-definition/5b89acc4-603f-4379-a9a4-1afaa1092bfc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "5b89acc4-603f-4379-a9a4-1afaa1092bfc", "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.669 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-229a0797-ea0a-48ef-beac-2acb0be3ba4a', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:07.701 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3f15b5a5-d5c2-48bf-9574-72c04ed8ec45', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:07.785 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-24f62aa1-49e4-40fb-b78d-94d9129cb5b2', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:07.825 7fe241f2ccc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6e21e113-8703-4138-9ef1-e1d4ad369e18 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = http://10.0.0.17:8082/role-definition/6e21e113-8703-4138-9ef1-e1d4ad369e18 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "6e21e113-8703-4138-9ef1-e1d4ad369e18", "fq_name": ["default-global-system-config", "crb-mcast-gateway-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.856 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-abb38866-34d3-40d7-9ab4-7cf9bb665c5c', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:07.888 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8a06d395-643e-4831-935f-de879178462f', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:07.926 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3c89b6ac-37b2-4f4d-9d47-641ac492b9da', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:07.953 7fe231288b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6a0ecc47-249f-4612-bfb6-77ec0945561c object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = http://10.0.0.17:8082/role-definition/6a0ecc47-249f-4612-bfb6-77ec0945561c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "6a0ecc47-249f-4612-bfb6-77ec0945561c", "fq_name": ["default-global-system-config", "ar-client-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:07.975 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-73090664-d9b5-439b-9c20-5ebb9d7d95b8', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:08.029 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-e259215b-d990-4598-8100-58a4499bb111', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:08.072 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-94e6b5b5-9284-4214-b956-9c495adecd05', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:08.094 7fe241f27780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7e0a71a6-2ee5-488f-a53a-255d6e9fec0e object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = http://10.0.0.17:8082/role-definition/7e0a71a6-2ee5-488f-a53a-255d6e9fec0e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "7e0a71a6-2ee5-488f-a53a-255d6e9fec0e", "fq_name": ["default-global-system-config", "ar-replicator-spine"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:08.120 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-253234f9-7bc7-48cd-bc25-69c11daeda30', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:08.184 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-0c9dfdda-8ee1-4fe2-bbb9-438b3a0e4193', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:08.230 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-57db1947-df4c-4a6d-a904-04f566e87229', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:08.273 7fe231265978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = dd5bf8be-be73-4697-b99e-20e460609b17 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = http://10.0.0.17:8082/role-definition/dd5bf8be-be73-4697-b99e-20e460609b17 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "dd5bf8be-be73-4697-b99e-20e460609b17", "fq_name": ["default-global-system-config", "rr-leaf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:08.305 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-39d60382-b41c-49ad-ac69-6bf373fd5ca4', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:08.336 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-ea8783aa-36f8-498f-909c-16f6c9547900', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:08.419 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-d3cd9779-6cd6-4d81-adbc-fba363b9e726', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:08.443 7fe2313c66d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = eb8b734f-febd-4f9b-9e4f-d10fbbbff578 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = http://10.0.0.17:8082/role-definition/eb8b734f-febd-4f9b-9e4f-d10fbbbff578 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": "eb8b734f-febd-4f9b-9e4f-d10fbbbff578", "fq_name": ["default-global-system-config", "pnf-servicechain-pnf"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:08.463 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-126114a8-4d88-45b4-8fe2-f2946f022be6', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 01:57:08.491 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-90921cb9-baaf-4529-81e3-e67f02b4f700', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 01:57:08.578 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ee81fd4d-c833-4de9-b5de-2a2bd5d572e2', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 01:57:08.598 7fe2314226d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a0315fe1-ddae-4344-837f-f74273aa0297 object_type = feature_config identifier_name = default-global-system-config:erb-leaf:l3-gateway url = http://10.0.0.17:8082/feature-config/a0315fe1-ddae-4344-837f-f74273aa0297 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature-config": {"uuid": "a0315fe1-ddae-4344-837f-f74273aa0297", "fq_name": ["default-global-system-config", "erb-leaf", "l3-gateway"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "use_gateway_ip", "value": "True"}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:08.627 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'oper': 'UPDATE', 'request-id': 'req-7a3a19db-6790-467c-9ddc-939a908872c4', 'type': 'feature_config', 'uuid': 'a0315fe1-ddae-4344-837f-f74273aa0297'} 02/10/2025 01:57:08.665 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-62cabf93-3b48-4a94-9d3f-73279e58cec5', 'type': 'feature_config', 'uuid': '2d7e3ef3-17a8-4f9c-a24a-19f3cb8119e4'} 02/10/2025 01:57:08.731 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'oper': 'UPDATE', 'request-id': 'req-74cb7680-07f6-4ed5-8e4f-7e6350dcdc66', 'type': 'feature_config', 'uuid': '2da8a076-b77b-4fc9-b14c-b41e55ff3cef'} 02/10/2025 01:57:08.855 7fe2311f7978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3c7f262f-cd41-4377-a392-62ea490e5ec9 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = http://10.0.0.17:8082/node-profile/3c7f262f-cd41-4377-a392-62ea490e5ec9 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": "3c7f262f-cd41-4377-a392-62ea490e5ec9", "fq_name": ["default-global-system-config", "juniper-qfx5k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:08.877 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-56b6c7a6-0ebf-4898-97f4-a611d0199e00', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:08.923 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-50f2bb90-f414-4da2-a93f-b333ac0ec01c', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:08.957 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-1fb79f51-2811-46d8-b140-d794e9b11462', 'type': 'node_profile', 'uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1'} 02/10/2025 01:57:09.026 7fe2311d24e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f58a9645-a13d-401a-a449-0532409d243a object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = http://10.0.0.17:8082/node-profile/f58a9645-a13d-401a-a449-0532409d243a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": "f58a9645-a13d-401a-a449-0532409d243a", "fq_name": ["default-global-system-config", "juniper-qfx5120"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector", "AR-Client", "ERB-UCAST-Gateway", "CRB-Gateway", "PNF-Servicechain"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "Route-Reflector", "PNF-Servicechain", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:09.047 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-9d5616b5-e382-4a89-946f-f5780f7e026e', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 01:57:09.103 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-f0ebd08c-adb9-42ef-96b0-e5fbdc85834b', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 01:57:09.160 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-093db7f0-938a-4977-bca0-be33fae6eeb3', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:09.211 7fe2311e32e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c332b70e-0113-4787-a186-5e1f2afcbdb1 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = http://10.0.0.17:8082/node-profile/c332b70e-0113-4787-a186-5e1f2afcbdb1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2705-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": "c332b70e-0113-4787-a186-5e1f2afcbdb1", "fq_name": ["default-global-system-config", "juniper-mx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway"]}]}}} domain = default-domain project = admin user = admin >> 02/10/2025 01:57:09.252 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-65081060-dfdf-4e77-93ae-763253ce8882', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:09.360 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-87acd502-51b8-4bc7-addc-8db914719086', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:09.414 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'oper': 'UPDATE', 'request-id': 'req-8c91bdfd-32ed-4d4a-bb2b-aa81036d8372', 'type': 'node_profile', 'uuid': '6b495a03-0b59-4afa-ab98-ab9c44ca18d3'} 02/10/2025 01:57:10.004 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-9828f0d7-1904-49c0-b37c-40171eb0fb05', 'type': 'role_config', 'uuid': '16b08e95-e7ed-4c0c-b565-b3c4c8539e12'} 02/10/2025 01:57:10.043 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-fd7b718a-a8a5-499a-97f1-905b72bace80', 'type': 'role_config', 'uuid': '01f97897-9f25-450e-9e9a-eed9a64d3573'} 02/10/2025 01:57:10.138 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-2f345762-1790-46b8-baae-4f8733dd8a13', 'type': 'role_config', 'uuid': '9a835dd1-a63c-4b9b-a2fc-9d47a274c554'} 02/10/2025 01:57:10.233 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-39a80a47-f23c-4681-90ba-b44a8bbd773a', 'type': 'role_config', 'uuid': 'b9e0c363-3e3f-483d-a84e-300767825448'} 02/10/2025 01:57:10.339 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-26d57eeb-dd96-454d-90f5-5292c8185a1c', 'type': 'role_config', 'uuid': '18729061-d816-4c51-9b06-347994b623af'} 02/10/2025 01:57:10.433 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-ebb0cd91-5c85-4013-8f95-e7951d6c7f68', 'type': 'role_config', 'uuid': '5290555a-8270-4c67-a219-701c8edee88f'} 02/10/2025 01:57:10.518 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-31ac4df1-d438-4586-8633-4b67def89ba3', 'type': 'role_config', 'uuid': '426e2ebe-d444-4b3a-b231-47433b950e52'} 02/10/2025 01:57:10.599 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'oper': 'UPDATE', 'request-id': 'req-a6f25f5f-a5e2-4c17-9b8a-e4ca686267eb', 'type': 'role_config', 'uuid': 'c3ae8052-8d5d-4679-91b9-ab648f4a15b1'} 02/10/2025 01:57:10.688 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e6f2cf5e-e454-4d40-82de-097f40eaf190', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:10.794 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fcdfab7e-4958-4343-8e93-d865ac71f598', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:10.900 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cb8d191d-6fa7-4f3c-b217-ab594ccc861d', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.000 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f86778d0-c1cc-439f-9d77-194c0b85dfc5', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.087 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1905418a-92fe-4bc9-bb0b-31ec02e349d3', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.186 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8de50cca-5aa8-4a33-8f3f-99bb200d5fad', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.263 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-65ae8105-b6e5-40b5-8f41-1deed8d965f3', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.355 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-77c51904-4fe9-44d2-8bb7-93e872d440ed', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.465 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-75b6ab00-a51c-4770-a203-c973052d4a89', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.558 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-017e2358-6972-4297-9db0-73310f9cd32a', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:11.661 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-dcc24028-f88a-4e88-a739-77d5c5960d26', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:11.750 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b65bf164-6a82-445f-b4c6-9c81a1b9e5b0', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:11.900 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-708e7284-f12b-4fbc-b863-d30dff939ebe', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.015 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-eff0371d-796f-4917-8aeb-89d0f9b4f510', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.120 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7a0363a9-8e6b-497b-bb39-e11e48e64d9c', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.225 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-befd375a-a9ac-4af3-9fe5-22df68ad3f13', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.347 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-69b58c74-34db-4c14-b932-81519675b4a9', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.444 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7e729535-7d7c-4a2a-8ad3-e13e16b71ad7', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:12.540 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-6d75c83a-bdd7-4bf0-ab1c-30e4878664bd', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:12.629 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-d156899a-2201-4902-a5b8-7dca65c7732e', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:12.710 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-208c04b3-5f9c-421d-ab1e-ffdc862754b4', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:12.812 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-24d474ea-a2fd-46eb-8ee5-49856971de5e', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:12.928 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-d4611ca3-bf18-4dfc-8941-e5a5d8d333d2', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:13.031 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-138b335b-994b-4014-b2bc-3b3afc742dcc', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:13.121 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-904f5f40-32e0-4835-996f-a1a6ebd62272', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:13.232 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-700b3612-879b-418a-a158-fc1ea9c369bb', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:13.333 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-63ee86cf-0c4d-438e-b384-73db7ec6b1be', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.436 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-56c364b4-0cbe-4d5b-88e1-cf296075fff3', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.528 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e1139b82-2584-4858-b9ca-0a0f0469ba61', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.618 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d4b9bf80-18e8-4bf3-a4b2-71f12c0e781b', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.707 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b6ef55f8-add1-455d-bffb-d832e083d102', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.826 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d647f2bb-d985-48bb-9fb6-3a7d59464803', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.870 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-66961bbf-94da-4b3c-8e3a-e39007b8d6fe', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:13.977 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d6c3359a-e9ff-4336-bd6f-36e0aab6b956', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:14.117 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4ae873cb-11cd-4198-8e1d-055d3662d82f', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.217 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-23320130-58fc-40c4-be8d-3ddb0d079578', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.297 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6da5ea3a-73d7-472c-a35b-f090e9840522', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.388 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3aebe337-39fb-4474-9767-9e0884a6f2b7', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.487 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-375fe533-ab61-4b86-9621-d9b8875b76b6', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.578 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-81f5ebca-746a-4e00-a650-83608b58d7f5', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.666 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b0cca2c9-e2db-4489-a6f4-5fc9279a7a92', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.746 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-126e7ad4-c73c-445c-97fd-ada8b6fdf1b5', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:14.827 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e44f7266-fb18-4f8c-825e-e830c58277b4', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:14.942 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8a371781-168b-4e51-a5ce-027a29a616e0', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.012 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4727cb9d-ed9c-4a08-8769-0b9bb4a28d53', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.097 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8430e955-2f51-4b9a-b6a2-f7a9b9f90654', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.177 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a89ed389-ae0b-4b90-a593-812f3390654e', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.252 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2adea00f-0863-47d1-a54c-0ceb91925b71', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.332 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4c340170-f073-4eda-8a53-066c3099a22f', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:15.420 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1361ff5a-cce5-4f6d-be16-f049f30c7c81', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.505 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e10e6cc6-6a42-4816-ba09-c13f3ebd2018', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.595 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ca62a892-dd6f-4150-92db-95f849d433cc', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.671 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cac398aa-3c0f-4318-9ff4-3f9645ade8e5', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.752 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-abbd5dbe-f748-4a8b-8178-b2f7af75b6f5', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.835 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-af0315a7-4122-4f2e-89c4-cbcc59b2939c', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:15.922 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-73fea5a7-eead-40ae-b0cc-687c800de432', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:16.000 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7b9f7241-79c0-4faf-a087-3ff41981048a', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.085 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c086d94f-7adf-4277-8031-caa4e6270f0a', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.180 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d0b152ff-94e0-4ab3-b8ea-4d31b04ac408', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.256 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-37cda522-33a5-4531-83cc-51b19f435d46', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.333 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d11fc6bd-76ea-45ec-9429-9e43f4bb9a8e', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.420 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-281c3d32-34d4-45ef-b859-295e696632f6', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.518 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e4a7b007-3b6c-4b1b-86b1-88b5b8c30930', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.612 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-de41becc-f301-4fac-a228-53772a0426bd', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.694 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-683499c2-d9dc-49db-994d-59c6c8d47c31', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:16.790 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-b3e80e3b-31f9-40c6-b19d-bc28f8f6116b', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:16.873 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2c5a0258-5044-4fc5-a68d-e9356ad6b2cb', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:16.966 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-5fc038e3-4925-457b-82f5-0be1033da92f', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:17.054 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-64768a77-935c-4942-be23-f509723987d9', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:17.138 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-b11c669d-521f-4016-b6cf-87faa41933f9', 'type': 'role_definition', 'uuid': '7e119ea0-e646-4dce-a670-af8e96f440fd'} 02/10/2025 01:57:17.216 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-6c4009f8-0bfe-42d1-b78e-32c7a12e97c2', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:17.306 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-bb1fecd4-6115-4b60-b412-b1e6a929ebde', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:17.388 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-3556972d-3ed1-4696-8660-45d04f45dbf0', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:17.462 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cfe1409e-f4d4-4020-8061-7ab7ced4c403', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.543 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-44164796-3462-4317-ae84-6f086a1f084a', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.629 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3ece4584-4796-4474-8c69-38307da37520', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.724 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8c191932-ff0c-4259-baf5-b3a80597a2ff', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.807 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5027cc22-7bfe-49fe-a19a-28fe22602d62', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.899 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-26470522-e433-4af2-9e5a-9d2278d475fd', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:17.977 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c4c24e95-158c-451a-96cb-cedf1de6786d', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:18.051 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-091402c8-bb64-4657-ba2e-bf6a6432d252', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:18.139 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d943a92d-ab41-4a42-abe9-784f060f8caf', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:18.217 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-75de0ecc-e04a-4339-9156-6e506e11cbdb', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.317 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-29d3447a-0897-4cf6-993d-224e7cfb46c6', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.413 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0b30db24-d3c1-4d87-8fba-d19180d4d67a', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.505 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-1ef6f068-7550-4446-bbca-26754445e1c9', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.587 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d65ac3dd-cd38-46ea-8264-50ddb2155f53', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.662 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-5fce9cf4-b1e0-4fd1-9869-0b3ce919c73e', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.745 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8c9ccdb2-3116-4e00-bae5-280f99f18556', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.829 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-a537f38a-5162-4728-8dd0-5e595c9d1c8d', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.910 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-6521d976-9845-47a7-bb9e-dda6ac1c24c6', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:18.990 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ab4e786e-733e-4ac0-926b-160e48728a86', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.071 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-36dbdab6-75e2-4ed5-8e05-da3d18f6af8b', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.152 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-040271a1-45dc-468b-84d3-395c8a2a6c26', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.234 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-503ebb8b-755f-4b3e-8435-20d89eee4a76', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.315 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-961f8335-89e7-4ccb-88e7-af53e3be6790', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.388 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-94e899b1-ebc8-46bf-93f0-3f1c16027b0a', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.476 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4d61006b-0f30-44ea-bc03-9406dd0f51c8', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.552 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-edef677a-9d4b-494a-b30c-52c28938d579', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.632 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e54c60cc-c774-4d9c-b12e-d906688691e3', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:19.706 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-d549e8b4-0706-41bf-b3ce-c3b1235b1e00', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:19.788 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e8f428db-fb04-46f8-88a7-d7b0493a5b34', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:19.866 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9576240a-136d-4af9-894a-140edf881daf', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:19.946 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1f9c1ef2-91d9-418e-9ac6-6810692a33e6', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:20.024 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-d653e8f5-14aa-41be-97c8-215e52c34877', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:20.103 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-0d162b61-0b96-4c78-9a5d-9edde1983977', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:20.181 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-b3f8016b-257c-428b-b45a-8eb2602f0f52', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:20.251 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4ef48c26-e651-4c05-b107-97ee31dcf914', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:20.331 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b5b73f5e-a12d-4202-a0ff-1b843db6807f', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:20.534 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-79ff6bb3-15e3-481f-ba53-d5f26d4b903e', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:20.612 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-825b02e7-97b9-4bd7-83b0-1d11f4048f92', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:20.696 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-495613f2-5542-43e0-816d-ec41c52e57d2', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:20.782 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8b69aee4-8e7e-4302-bc16-bf0e56d2b472', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:20.863 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-2977af88-d9a4-484e-b0dd-00486d47144e', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:20.941 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-899daf29-38de-40db-8b35-ddc777954f88', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:21.028 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6d0e83cc-82f7-4f65-9d28-c0fa75924fcf', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:21.109 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-af2e0af6-01be-401f-995d-e56f6aaf744b', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:21.187 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-d0f42293-48ad-4797-973b-b653af09ad37', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:21.265 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-0ac4160b-e491-4856-8b9a-ad799e5a5b97', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:21.345 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2bca29d2-d6ad-4cb3-8f97-ef565b036895', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.427 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-14cfcbb3-3a20-44fd-a8e6-b3927624f95d', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:21.519 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-513a08dc-8383-40ff-a88b-f8e10ccdb46b', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:21.602 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-9ce7e5ea-b979-4857-87fb-cfe5cb60fc63', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.682 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-58ba5072-fcfa-4b83-8cd2-66a43245e1a3', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.741 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-3b00ce9b-c501-44a7-9f30-07cb4a38e025', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.815 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-333f061c-4859-4962-8219-dff02c16c7e0', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.893 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-716667b0-507d-4677-92e0-98e8a70de21d', 'type': 'role_definition', 'uuid': '0685b562-d2c5-4db6-99af-54640150880b'} 02/10/2025 01:57:21.974 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-1aac840e-57b3-4333-a4fa-f1c2a9696c5a', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:22.048 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-314031d9-0931-4e92-8675-8cd83068dbb6', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:22.124 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-46723549-dbfc-410f-af11-4d29ab67e331', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:22.202 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-ab7a279c-09db-4983-b1bc-0ed64dbf5727', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:22.281 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a859a8f8-95bb-4295-b7fb-1ffa412aa408', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:22.363 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c334d022-ebd6-46ee-820f-9aeb5c430e45', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:22.456 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1cc764b8-b0e4-4f2e-9eec-014ddf2f253f', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:22.537 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bdb09039-9dd2-4acf-baa8-bb7ee7e5f5be', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:22.616 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-93518ad5-f35c-4c3f-b3b0-763ac8f64de3', 'type': 'role_definition', 'uuid': 'bd9c524a-d1bb-4199-abb0-ec61484ad343'} 02/10/2025 01:57:22.700 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-87c094a4-d97c-4384-911b-a9f90875dd1a', 'type': 'role_definition', 'uuid': '102db454-fedb-4a51-beaf-acadbd988556'} 02/10/2025 01:57:22.778 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ab0a429c-3fc4-4381-bb11-11b1da63dce8', 'type': 'role_definition', 'uuid': '7c14aa5a-737d-46fd-944a-ba41589afa19'} 02/10/2025 01:57:22.868 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-40e8643f-1624-4676-94ea-f9d9e1159bbc', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:22.944 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-486010f5-d6b9-4010-90a0-76015eea17af', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:23.024 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2321f637-0406-478f-9038-8b1b403ad825', 'type': 'role_definition', 'uuid': '5b89acc4-603f-4379-a9a4-1afaa1092bfc'} 02/10/2025 01:57:23.102 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-be44c3bd-2099-4fc0-a507-d94b2239839a', 'type': 'role_definition', 'uuid': '12b64228-b54b-4c3d-a2dd-076d8223521f'} 02/10/2025 01:57:23.192 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-dbd59b05-8268-4ba5-aa21-b339cdbd2857', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:23.269 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-871f3d68-fd6f-4780-8b34-43c8bcab1d1f', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:23.348 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fbe2abc2-1437-4af2-a8aa-1c9af03411ff', 'type': 'role_definition', 'uuid': '73f5dfe1-d828-4c1b-b566-2ff447c7b14e'} 02/10/2025 01:57:23.429 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3c375e8d-0878-4f5c-832a-3b55bbb86efa', 'type': 'role_definition', 'uuid': '570093fc-45e4-4b16-a8ce-c0fca9b2054a'} 02/10/2025 01:57:23.504 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e0cae551-5689-4f17-a20f-31415557bdee', 'type': 'role_definition', 'uuid': '6a0ecc47-249f-4612-bfb6-77ec0945561c'} 02/10/2025 01:57:23.580 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-cdfb44c9-ed4f-4193-8afe-c2a64b1f3122', 'type': 'role_definition', 'uuid': '143ce8e8-2ae1-4941-9616-6c53ddef191a'} 02/10/2025 01:57:23.660 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0ea16200-a65f-4b18-87dd-32e93b2659a2', 'type': 'role_definition', 'uuid': 'cfe07a90-005b-453e-8c2f-471b7aaccef0'} 02/10/2025 01:57:23.746 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-f340a623-3d52-4b4b-8310-db6b2293a782', 'type': 'role_definition', 'uuid': '7e0a71a6-2ee5-488f-a53a-255d6e9fec0e'} 02/10/2025 01:57:23.820 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-aa4cbb24-adc5-4f21-a840-fb2938e45132', 'type': 'role_definition', 'uuid': 'd6f6e79a-7e63-4690-a85b-49c35109a4f8'} 02/10/2025 01:57:23.905 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c31569bf-879a-4555-b90b-ea59b1e4b17a', 'type': 'role_definition', 'uuid': 'dd5bf8be-be73-4697-b99e-20e460609b17'} 02/10/2025 01:57:23.983 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-5039fb00-5d03-4b8e-89bd-0154a020ed43', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:24.080 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-aefd3826-9215-4609-abf0-6bb47f750e6c', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:24.159 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-75dd1365-ea86-4560-8572-41f21db0fb11', 'type': 'role_definition', 'uuid': '7651148d-f1e8-4cc7-9afe-10523a34969b'} 02/10/2025 01:57:24.243 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f50deba8-20d5-4e30-89cc-985f1f67a0e8', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:24.320 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c8020833-8835-4bbb-a85e-aee08910fd54', 'type': 'role_definition', 'uuid': 'e3f3540b-ef50-4953-b3f2-5ee10a4bc4d6'} 02/10/2025 01:57:24.401 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-951c3575-ac9e-4df8-b625-37e9aa41598b', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:24.494 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fab80700-2b49-4bdf-bd65-42c89f708cea', 'type': 'role_definition', 'uuid': 'd218c930-74bf-4d6d-912b-def97d93ff12'} 02/10/2025 01:57:24.576 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0a945259-bc18-4a1c-b3c5-0379a1a4baa4', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:24.658 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fc3ff908-f83e-4bd0-9500-532ff55b0333', 'type': 'role_definition', 'uuid': '6e21e113-8703-4138-9ef1-e1d4ad369e18'} 02/10/2025 01:57:24.733 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-f66c7ec5-74ff-4cef-8042-9479ec02e85b', 'type': 'role_definition', 'uuid': '35c813d3-71f4-4a03-b9f0-4e52ca8938a5'} 02/10/2025 01:57:24.810 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-52d3cc39-edaa-4478-be5c-465aee6e2119', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:24.886 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-c5e8f327-64d8-4fde-a14f-8fc306b531fb', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:24.983 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-db014a49-0068-4829-89fc-6c57ad3cbb55', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.060 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-f9a1c9c0-d5ff-4ac1-8be9-2449592ca766', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.144 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-69183265-3ff1-4823-bfd1-1346de00a7fa', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.245 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-3200567c-611b-4173-a25a-133ee386a6c5', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.320 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-22c011fc-d60e-48fc-bfed-fc3bd4b7454e', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.395 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-b0f244a8-8091-41f9-8217-04d074439a8f', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.471 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-6d8b1dd5-796e-45a5-a373-6264c557d43f', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.545 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-0c6072f6-966e-4cf2-9283-7106415d4457', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.633 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-3a5a6455-58dd-46e6-a709-2398dc472a95', 'type': 'role_definition', 'uuid': '957c2ef0-b286-4d13-9ae7-3c1a2764a65d'} 02/10/2025 01:57:25.864 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-6d0f594b-f882-44aa-8a94-eed94e37f6ef', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 01:57:25.947 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-27e9521a-ae2e-483a-ba34-6a7c7d503ea7', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 01:57:26.028 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-786659c2-3d62-4b95-a0f1-108b5ffec077', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 01:57:26.112 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-1fb3dee8-e4a0-4e04-83cb-1a638c945800', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 01:57:26.198 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-561c12c0-a232-4221-9353-a8164f5d60e7', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 01:57:26.278 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-363c924d-a258-45c1-a864-0325da14c6ca', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 01:57:26.353 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-4dd9f05d-76d8-4853-9741-a9143b2e1e56', 'type': 'role_definition', 'uuid': 'eb8b734f-febd-4f9b-9e4f-d10fbbbff578'} 02/10/2025 01:57:26.430 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-9b532f05-5e22-4c6d-b231-5172cbfe480b', 'type': 'role_definition', 'uuid': '00d46976-c429-4676-9e25-e5f8d24fe8ea'} 02/10/2025 01:57:26.511 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-116e5b84-a025-4b63-b7e2-45459e17bfc7', 'type': 'role_definition', 'uuid': 'c2747a05-90f8-4ff9-98c8-d2b52215282d'} 02/10/2025 01:57:26.608 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-843b317f-c341-4681-abba-a1de48595584', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:26.689 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-937d4026-b5ac-41ec-88bf-8d0e22369dd3', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:26.775 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-336c4c53-8d11-46cc-88f4-d4c912ef613e', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:26.847 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f3d09062-304f-4042-9ad9-37c7e98ffdcd', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:26.920 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-097f55ce-4764-4ca8-a378-218fa610dcaa', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.002 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f1f69589-9dbe-47e9-8144-ed936be48145', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.080 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-75e1568b-610e-4682-aaff-e70f5f103ed1', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.157 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-f52c4214-e4f8-46aa-93be-fa0fa0cae28a', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.239 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-60b9ebca-b597-404e-a2e0-7a880740d77d', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.322 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-330946b7-d6ff-4992-83d8-fad4d7d3fcb1', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.402 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-813dec9b-91ae-4d1e-ab46-4563f39a8d70', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.479 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-965f23c0-8286-41db-88b4-7a487cd17418', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.561 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7603d4c2-e089-4904-b316-77cca48747f5', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.636 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-0d6c47cf-3eff-4449-948c-32f2799082fa', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:27.713 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-31063a8e-79a7-4a92-bfa7-c06dac3c1c97', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:27.786 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-02b9c5d4-cd74-4dc7-a658-515549795ca3', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:27.858 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-70159ea1-e20e-40b8-8674-2619e50ac04f', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 01:57:27.934 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-15960dad-e4ff-4fe8-bf19-38826e4efee9', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 01:57:28.012 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-ef67216f-3699-4fc8-a4ea-3b7f7ca4319c', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 01:57:28.093 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-99735555-f07f-4260-aaee-d19b465cdfdb', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:28.176 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-a57394ad-1b4f-4c9e-a704-7c4ab0539c39', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:28.250 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d864be1f-9c3d-46d8-95d7-84fc63ad1026', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:28.331 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-8c845cb9-ee39-43fb-ad75-0fc11f162ddc', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 01:57:28.406 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-6bf0720a-2c08-4a66-bc9d-34c2e18a9f95', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 01:57:28.482 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-39cc7fa4-6a1b-45e3-8483-a666437a6eef', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.567 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-5923e508-740b-4278-99a1-6e5c50620a37', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.637 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-36f96349-2a42-4483-9cfa-e8ac4cfcdcc4', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.717 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-a5031c76-1746-44df-94e2-12dfab232ccf', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.809 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-970ca809-047f-415b-b23c-ba0a69d22d9e', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.904 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-b00a9edf-c6e8-4d5e-a2f1-63af880fea10', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:28.994 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-42fb980e-538d-48c1-9481-86dada79bab7', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.075 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-c98e56f0-7198-43b7-baf6-0d2798923dd2', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.167 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-3021dfd2-b2dd-449c-984e-1491e01f5d38', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.257 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-349425f3-be62-4ceb-9b05-c730a50964b9', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.337 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-81142a58-5990-48a4-a400-032a775f12c5', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.423 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2f13db52-6ac6-4f79-84d0-45196d929031', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.499 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-74510408-46d6-4dd3-b20f-95e15a657a2c', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.590 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-5ed65572-88cc-4620-9900-78a7d541a173', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.683 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-eb2bfbfd-a7c0-43de-b5b8-f7b44f82312b', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.756 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-25c6a897-ebe1-4406-8588-e130c190bbeb', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.833 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-17fe5fef-cfa4-4d03-948a-54fee1ddf9e6', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:29.916 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a7e442d2-5311-4c3b-9e87-52c70cd9f451', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:30.010 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a388bd90-4c73-4b8d-9103-0dc005441261', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:30.084 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-3f974ed3-dd1f-46a7-99a9-557cd04e2d74', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.169 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-e86c84e0-4c2e-4243-8a1e-dd1c95bb4b47', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.252 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-944998dc-c9c8-41f0-82b2-865c467a2b13', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.331 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-b7f19d51-f45c-4115-be54-296841d019f8', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.408 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-ee78fd31-fa81-4fe5-b361-d355cc3f3b50', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.486 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4d1c74b5-be18-45e8-8681-44e08d721c31', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.581 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-60c9b313-705d-48b4-bcfc-c10e60200b01', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.666 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-b77127a1-9639-48e7-a4a6-64f3ffeae5ee', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.772 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-9927e156-c85c-4726-b650-472db9e39637', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:30.854 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-92932933-22e6-4f25-9b08-9d90c54d0710', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:30.930 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-c7c3ead4-0c31-455b-a6d4-02315e881ab9', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:31.006 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d7f2aa33-0724-49a1-8396-53d9bc60083b', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:31.098 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-258628f8-966e-40b3-90ef-8838495d1dd5', 'type': 'node_profile', 'uuid': '3c7f262f-cd41-4377-a392-62ea490e5ec9'} 02/10/2025 01:57:31.175 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-31925600-8810-4241-b0e7-4295d79305fb', 'type': 'node_profile', 'uuid': '414dda90-89e8-43e2-8475-cfa8f88b5213'} 02/10/2025 01:57:31.246 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-4cbbc93f-5b90-4855-96b6-379d57717f53', 'type': 'node_profile', 'uuid': 'f58a9645-a13d-401a-a449-0532409d243a'} 02/10/2025 01:57:31.321 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-c38a6759-a967-4fce-bfe1-b4d5658af878', 'type': 'node_profile', 'uuid': 'ad0b9d69-843c-47f4-88d0-9feab0a84ec4'} 02/10/2025 01:57:31.406 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-b3dab137-2288-44cf-8da7-d1ddaa8c031d', 'type': 'node_profile', 'uuid': 'f7842a28-5809-4cbb-98e3-9a3e9c740ce1'} 02/10/2025 01:57:31.478 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-e085c7e4-6b22-4cff-86b5-f9e5dba581a6', 'type': 'node_profile', 'uuid': '87946db4-feed-466b-88d4-3ffdbe1dcb72'} 02/10/2025 01:57:31.558 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-676a1d60-6a43-43ea-9594-9cf86a57aec3', 'type': 'node_profile', 'uuid': 'c332b70e-0113-4787-a186-5e1f2afcbdb1'} 02/10/2025 01:57:31.632 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-64c270b8-4b5c-435b-99f9-8f9d117732b1', 'type': 'node_profile', 'uuid': '2b995fa8-0614-4c89-9407-b3d15633ba4b'} 02/10/2025 01:57:31.719 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-77decb2d-56f7-4780-a56b-ddbe01ff2586', 'type': 'telemetry_profile', 'uuid': '25b49bb0-c5f3-42e7-a7fa-973091dfa83b'} 02/10/2025 01:57:31.794 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-aab5228f-ad8b-4f99-a900-fec94706a5a7', 'type': 'telemetry_profile', 'uuid': 'e5c98937-d766-4af1-9e49-207fae37955e'} 02/10/2025 01:57:31.874 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-9a6f66b2-40b2-43a8-af55-58717acaf9cc', 'type': 'telemetry_profile', 'uuid': 'ea038e42-66eb-4959-9a72-228800ca9108'} 02/10/2025 01:57:31.951 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-8f3092ab-1398-4da9-8d8a-eadf60a17835', 'type': 'telemetry_profile', 'uuid': '1200cf88-eab3-4afd-a2e6-741133b7ebc1'} 02/10/2025 01:57:32.027 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-96398b14-70eb-44a9-8030-5cf354c3f81b', 'type': 'telemetry_profile', 'uuid': 'be09972d-1976-42a7-a81e-5eb6a7379213'} 02/10/2025 01:57:32.103 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-65690531-b2fa-470d-9a6d-88e3be1f3e16', 'type': 'telemetry_profile', 'uuid': '7ae2af27-0e43-4665-8f2d-b88f24108be5'} 02/10/2025 01:57:32.177 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-8344e59f-bd84-4a43-a009-a5bc3075aea8', 'type': 'device_functional_group', 'uuid': 'fa1ce1b7-37ed-498b-9e38-fc6774c5276d'} 02/10/2025 01:57:32.282 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-24ab9c1f-ddcc-4214-b6fc-ddecc197552e', 'type': 'device_functional_group', 'uuid': '012ad82f-c7ba-4796-9b07-4ac9d8404469'} 02/10/2025 01:57:32.367 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-d6a746bb-4096-4f8b-a218-0ff2b486315a', 'type': 'device_functional_group', 'uuid': 'dd78031c-0a8c-4a4d-833f-39cbd73d4e0e'} 02/10/2025 01:57:32.453 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-78d65015-f70c-44e9-acaf-12fad7cbadde', 'type': 'device_functional_group', 'uuid': 'd41d682e-e80f-4a99-b2cd-c4ac483b4ea2'} 02/10/2025 01:57:32.542 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-94d3a9c5-fada-4beb-8ebd-322046e2e74e', 'type': 'device_functional_group', 'uuid': 'eccf0edb-1adb-4362-b473-2e597267d2d4'} 02/10/2025 01:57:32.620 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-0daf2882-66d1-47f6-a60e-53424556bb80', 'type': 'device_functional_group', 'uuid': 'fd302250-fbd4-4aea-972d-996c428d4e90'} 02/10/2025 01:57:32.693 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-427299d8-0597-4cbc-b4fd-787f23b8ffc8', 'type': 'device_functional_group', 'uuid': '7cd811c8-efce-4d1a-bd13-20cc9ef1c6af'} 02/10/2025 01:57:32.768 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-5c7457d1-c3d4-4bc3-b593-8b512242ea62', 'type': 'device_functional_group', 'uuid': 'bb6830e2-8c07-4496-9f50-936aed91f40b'} 02/10/2025 01:57:32.849 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-adeebc55-acb8-4126-bf25-3fd8a036987f', 'type': 'device_functional_group', 'uuid': '1afb6513-5dc6-4ac2-8407-b5c8e84fedaa'} 02/10/2025 01:57:32.928 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-91d8f398-740d-48d5-8e8b-c6340bbcedd8', 'type': 'device_functional_group', 'uuid': '2c7ec997-dff9-4277-a899-7a2f5de54a72'} 02/10/2025 01:57:33.022 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-ff58d79e-aea7-4bd2-8034-d4ce14ab8fb0', 'type': 'network_ipam', 'uuid': '17731666-a2b0-4ded-ab05-94123e54d02c'} 02/10/2025 01:57:33.110 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'extra_dict': {'deallocated_vxlan_network_identifier': None}, 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-62d91266-ba7a-4f48-85a1-38c369555be7', 'type': 'virtual_network', 'uuid': '9816ff74-fff9-44f1-b27e-18cc06d73ad2'} 02/10/2025 01:57:33.164 7fe241679780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-62d91266-ba7a-4f48-85a1-38c369555be7', 'type': 'routing_instance', 'uuid': '9a498f7c-34e7-4f05-b457-f23549c7aac4'} 02/10/2025 01:58:20.647 7fe24b2c0f88 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Removing queue amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy 02/10/2025 01:59:51.528 7f91cf7d9708 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 02/10/2025 01:59:51.528 7f91cf7d9708 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 02/10/2025 01:59:51.528 7f91cf7d9708 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 02/10/2025 01:59:51.528 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.17:2181,10.0.0.12:2181,10.0.0.30:2181 02/10/2025 01:59:51.528 7f91cf7d9708 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 01:59:51.529 7f91c9431eb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 02/10/2025 01:59:51.529 7f91c9431eb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 02/10/2025 01:59:51.529 7f91c9435828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.530 7f91c9435828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.531 7f91c9435828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 01:59:51.531 7f91c9435828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.531 7f91c9435828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.531 7f91c9435828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 02/10/2025 01:59:51.531 7f91c9435828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.536 7f91c94e10f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.536 7f91c94e10f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/10/2025 01:59:51.536 7f91c94e10f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.559 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.17:9041', '10.0.0.12:9041', '10.0.0.30:9041'] 02/10/2025 01:59:51.559 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 02/10/2025 01:59:51.560 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 02/10/2025 01:59:51.560 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 02/10/2025 01:59:51.560 7f91c94f5048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.560 7f91c94f5048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:51.560 7f91c94f5048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.565 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 02/10/2025 01:59:51.590 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 02/10/2025 01:59:51.591 7f91c9504c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.592 7f91c9504c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:51.592 7f91c9504c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.598 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 02/10/2025 01:59:51.598 7f91c94fdac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.598 7f91c94fdac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:51.598 7f91c94fdac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:51.603 7f91cf7d9708 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 02/10/2025 01:59:55.533 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 01:59:55.534 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 01:59:55.535 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 01:59:55.536 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:59.536 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 01:59:59.537 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:59.538 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 01:59:59.539 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 01:59:59.539 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:03.543 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:03.544 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:03.545 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:03.546 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:03.546 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:07.547 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:07.549 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:07.550 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:11.551 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:11.553 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:11.554 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:11.554 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:11.554 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:11.554 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:15.555 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:15.556 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:15.557 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:15.558 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.17:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:15.558 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:19.558 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:19.559 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:19.560 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:19.561 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:19.561 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:23.562 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:23.563 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1739152791530186 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.30:8086, 10.0.0.12:8086, 10.0.0.17:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 02/10/2025 02:00:23.564 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/10/2025 02:00:27.563 7f91c9496198 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Session Event: TCP Connected 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2705-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.17:2181, 10.0.0.12:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.17:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.17:9041, 10.0.0.12:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 02/10/2025 02:00:27.565 7f91c9496198 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 02/10/2025 02:00:27.566 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 02:00:27.566 7f91c9496198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/10/2025 02:00:27.566 7f91c95756d8 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 02:00:27.567 7f91c95756d8 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 02:00:29.588 7f91c9575630 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 02/10/2025 02:00:29.588 7f91c9575630 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/10/2025 02:00:29.589 7f91c9584ac8 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 02/10/2025 02:00:29.589 7f91c9584ac8 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 02/10/2025 02:00:29.589 7f91c9584ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 02:00:29.589 7f91c9584ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/10/2025 02:00:29.589 7f91c9584ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 02/10/2025 02:00:29.590 7f91c9575780 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/10/2025 02:00:29.591 7f91c9575780 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/10/2025 02:00:39.762 7f91c9575630 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001296 02/10/2025 02:00:39.762 7f91c9575630 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/10/2025 02:00:39.763 7f91c93de438 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 02/10/2025 02:00:39.763 7f91c93de438 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 2 02/10/2025 02:00:39.763 7f91c93de438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 02/10/2025 02:00:39.763 7f91c93de438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map