Status for GSLBLoadBalancingChannel (butterknife)

Started: Wed Dec 10 07:23:50 2025 -- up 4 hr 07 min 58 sec
Built on Dec 10 2025 04:10:45 (1765368645)
Built at rbex-enqueue-targets@vqte5.prod.google.com:/google/src/cloud/buildrabbit-username/buildrabbit-client/google3
Built as //cloud/ai/platform/dataplane/cardolan:vertex-genai-dataplane
Build label: cloud-ml.vertex-genai-dataplane_20251210.02_p0
Built target blaze-out/k8-opt/bin/cloud/ai/platform/dataplane/cardolan/vertex-genai-dataplane
Build options: fdo=XFDO
Built for gcc-4.X.Y-crosstool-v18-llvm-grtev4-k8.k8
Built from changelist 842562885 with baseline 842562885 in a mint client based on //depot/google3
Task BNS: /bns/yudfwra/borg/yudfwra/bns/cloud-ml-vertex-genai-dataplane-staging-jobs/staging-qual-us.vertex-genai-dataplane/0
Ports:
esf.0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:8101
0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:14634
borgenvelope.0.staging-qual-us.vertex-genai-dataplane.cloud-ml-vertex-genai-dataplane-staging-jobs.yudfwra.borg.google.com:14635

Profiling Links:
 censusprofilez?seconds=30 (CPU profile with go/census tags, 30 seconds): esf:810114634borgenvelope:14635
 censusheapz (heap usage with go/census tags): esf:810114634borgenvelope:14635
 peakheapz (peak heap usage): esf:810114634borgenvelope:14635
 deltacontentionz?seconds=10 (contention, 10 seconds): esf:810114634borgenvelope:14635
 threadz (thread stacks): esf:810114634borgenvelope:14635
 mmapz (mmap() usage): esf:810114634borgenvelope:14635
 contentionz (legacy contention): esf:810114634borgenvelope:14635
Active RPC Experiments
Stubby: stubby_default_subsetting, go/inline-psp, 1rpc,
gRPC: channelz_use_v2_for_v1_api, channelz_use_v2_for_v1_service, channelz_zviz, chttp2_bound_write_size, deprecate_keep_grpc_initialized, error_flatten, event_engine_channelz_socket_info, event_engine_client, event_engine_dns, event_engine_dns_non_client_channel, event_engine_listener, event_engine_callback_cq, event_engine_secure_endpoint, google_no_envelope_resolver, graceful_external_connection_failure, lbns_support_in_address_resolver, loas2_protect_memory_optimization, max_inflight_pings_strict_limit, monitoring_experiment, namecheck_core_lib, privacy_context_single_encoding, prod2cloud_w3c_trace, rr_wrr_connect_from_random_index, tsi_frame_protector_without_locks,
Running on yudfwra-u5.prod.google.com
Platform: arcadia rome
Process size: 15446MiB Memory usage: 1739MiB Load avg (1m): 51.79
View process information, endpoints
View variables, flags, streamz, request logs
Links: code, g3doc, continuous pprof, automon
Distributed traces: view, change parameters
Remote Logs: INFO WARNING ERROR STDOUT STDERR 

Status for service blade:sherlog_prod Automon

Balancer Channel : Channel Stats
/mbns/local/loadbalancer/servers/butterknife-prod/balancers

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/mbns/local/loadbalancer/servers/butterknife-prod/balancers10*000000
/mbns/local/loadbalancer/servers/butterknife-prod/balancers10*000000
BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/400BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/100BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/300BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/210BalancerChannelControl.*000000
/bns/yudfwra/borg/yudfwra/bns/bladeservice-prod/bladeservice_dsc.load_balancer_common/000BalancerChannelControl.*000000

Primary : io : /bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server : Channel Stats
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server00*000000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/29700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/3700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/19500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/11100
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/27700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/7200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/23900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/15200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/31400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/600
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/32400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/16400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/8800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/24700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/4700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/20200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/12300
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/28100
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/2600
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/34800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/18900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/10000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/26600
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/6400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/22300
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/14200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/30400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/1500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/33000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/17400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/9200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/25200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/5500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/21900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/13500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/29000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/3500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/19800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/11800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/27500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/7700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/23800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/15800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/31700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/32200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/16500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/8700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/24900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/4200

Failover : qv : /bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server : Channel Stats
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server00*000000
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/29700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/3700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/19500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/11100
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/27700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/7200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/23900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/15200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/31400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/32400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/16400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/8800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/24700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/4700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/20200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/12300
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/28100
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/2600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/34800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/18900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/10000
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/26600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/6400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/22300
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/14200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/30400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/1500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/33000
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/17400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/9200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/25200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/5500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/21900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/13500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/29000
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/3500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/19800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/11800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/27500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/7700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/23800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/15800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/31700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/32200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/16500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/8700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/24900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/4200

Total RPCs sent through Fallback Channel: 0 : Channel Stats
/mbns/local/loadbalancer/fallback/758/blade_sherlog_prod

ServerReconnectsPendingMethodCountLatency (ms)RPC Errors
Min.Hr.Tot.Min.Hr.Tot.Min.Hr.Tot.
/mbns/local/loadbalancer/fallback/758/blade_sherlog_prod00*000000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/3700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/32300
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/19500
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/16100
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/11100
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/8100
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/27700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/24200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/7200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/4900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/23900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/20000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/15200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/12200
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/31400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/28300
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/29400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/32400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/16400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/13100
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/8800
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/5000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/24700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/21700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/4700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/33700
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/1300
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/20200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/17700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/12300
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/9500
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/28100
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/25900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/2600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/31400
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/34800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/18900
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/15900
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/10000
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/7300
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/26600
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/23700
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/6400
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/3000
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/22300
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/19800
/bns/io/borg/io/bns/sherlog-logging-server/prod.sherlog-logging-server/14200
/bns/qv/borg/qv/bns/sherlog-logging-server/prod.sherlog-logging-server/11800