Status for GSLBLoadBalancingChannel (butterknife)

Started: Wed Dec 10 15:22:35 2025 -- up 2 hr 10 min 40 sec
Built on Dec 10 2025 10:11:34 (1765390294)
Built at rbex-enqueue-targets@vqrc5.prod.google.com:/google/src/cloud/buildrabbit-username/buildrabbit-client/google3
Built as //cloud/ai/platform/dataplane/cardolan:vertex-genai-dataplane
Build label: cloud-ml.vertex-genai-dataplane_20251210.04_p0
Built target blaze-out/k8-opt/bin/cloud/ai/platform/dataplane/cardolan/vertex-genai-dataplane
Build options: fdo=XFDO
Built for gcc-4.X.Y-crosstool-v18-llvm-grtev4-k8.k8
Built from changelist 842677723 with baseline 842677723 in a mint client based on //depot/google3
Task BNS: /bns/yudfwra/borg/yudfwra/bns/cloud-ml-vertex-genai-dataplane-staging-jobs/staging-qual-us.vertex-genai-dataplane/0
Ports:
esf.0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:8119
0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:26135
borgenvelope.0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:26136

Profiling Links:
 censusprofilez?seconds=30 (CPU profile with go/census tags, 30 seconds): esf:811926135borgenvelope:26136
 censusheapz (heap usage with go/census tags): esf:811926135borgenvelope:26136
 peakheapz (peak heap usage): esf:811926135borgenvelope:26136
 deltacontentionz?seconds=10 (contention, 10 seconds): esf:811926135borgenvelope:26136
 threadz (thread stacks): esf:811926135borgenvelope:26136
 mmapz (mmap() usage): esf:811926135borgenvelope:26136
 contentionz (legacy contention): esf:811926135borgenvelope:26136
Active RPC Experiments
Stubby: 1rpc, go/inline-psp, stubby_default_subsetting,
gRPC: channelz_use_v2_for_v1_api, channelz_use_v2_for_v1_service, channelz_zviz, chttp2_bound_write_size, deprecate_keep_grpc_initialized, error_flatten, event_engine_channelz_socket_info, event_engine_client, event_engine_dns, event_engine_dns_non_client_channel, event_engine_listener, event_engine_callback_cq, event_engine_secure_endpoint, google_no_envelope_resolver, graceful_external_connection_failure, lbns_support_in_address_resolver, loas2_protect_memory_optimization, max_inflight_pings_strict_limit, monitoring_experiment, namecheck_core_lib, privacy_context_single_encoding, prod2cloud_w3c_trace, rr_wrr_connect_from_random_index, tsi_frame_protector_without_locks,
Running on yudfwra-ao1.prod.google.com
Platform: arcadia milan
Process size: 16070MiB Memory usage: 2213MiB Load avg (1m): 82.87
View process information, endpoints
View variables, flags, streamz, request logs
Links: code, g3doc, continuous pprof, automon
Distributed traces: view, change parameters
Remote Logs: INFO WARNING ERROR STDOUT STDERR 

Status for service blade:unified-logging-forwarding-proxy-thin-client Automon

Balancer Channel : Channel Stats
/mbns/local/loadbalancer/servers/butterknife-prod/balancers

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/mbns/local/loadbalancer/servers/butterknife-prod/balancers10*000000
/mbns/local/loadbalancer/servers/butterknife-prod/balancers10*000000
BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/300BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/010BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/400BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/200BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/100BalancerChannelControl.*000000

Primary : yudfwra : /bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy : Channel Stats
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy20*000000
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy10
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy10
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/12:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/29:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/10:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/36:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/0:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/24:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/18:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/34:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/7:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/21:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/11:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/30:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/1:forwardingproxy00

Failover : lcdfwe : /bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy : Channel Stats
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy00*000000
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/72:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/47:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/64:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/55:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/77:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/29:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/63:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/12:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/51:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/36:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/74:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/0:forwardingproxy00
/bns/lcdfwe/borg/lcdfwe/bns/unified-logging-sawmill-relay/uls.relay.relay/46:forwardingproxy00

Failover : rs : /bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy : Channel Stats
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy00*000000
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/55:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/47:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/64:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/51:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/29:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/63:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/12:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/54:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/36:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/0:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/46:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/24:forwardingproxy00
/bns/rs/borg/rs/bns/unified-logging-sawmill-relay/uls.relay.relay/62:forwardingproxy00

Failover : rt : /bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy : Channel Stats
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy00*000000
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/111:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/72:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/88:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/47:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/100:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/64:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/92:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/55:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/77:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/87:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/29:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/108:forwardingproxy00
/bns/rt/borg/rt/bns/unified-logging-sawmill-relay/uls.relay.relay/63:forwardingproxy00

Failover : yudfwnl : /bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy : Channel Stats
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay:forwardingproxy00*000000
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/55:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/72:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/88:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/47:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/64:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/92:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/51:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/77:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/87:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/29:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/63:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/12:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/91:forwardingproxy00

Total RPCs sent through Fallback Channel: 0 : Channel Stats
/mbns/local/loadbalancer/fallback/C54/blade_unified-logging-forwarding-proxy-thin-client

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/mbns/local/loadbalancer/fallback/C54/blade_unified-logging-forwarding-proxy-thin-client00*000000
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/37:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/11:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/72:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/6:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/88:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/47:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/23:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/26:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/0:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/64:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/42:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/15:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/92:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/55:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/33:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/35:forwardingproxy00
/bns/yudfwra/borg/yudfwra/bns/unified-logging-sawmill-relay/uls.relay.relay/18:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/77:forwardingproxy00
/bns/yudfwnl/borg/yudfwnl/bns/unified-logging-sawmill-relay/uls.relay.relay/4:forwardingproxy00