/streamz help
Streamz Root:
Streamz ManuallySampledMetrics set:
Root name: <default> [(+) labels] [(+) collection] [(+) largest exported metrics]
Search:
/cloud/ai/platform/dataplane/prediction/client/llm_client_context/wait_for_groot_response_count{string model_id} (cumulative): long = ...
QueryExplorer (monarch.BorgTask): task cell global
Count of times we wait for GRoot RPC to respond. Used for testing during dark launch, normally slow GRoot RPC should be cancelled to prioritize LLM RPC response.
defined at cloud/ai/platform/dataplane/prediction/client/llm_client_context.cc:211 with annotations: CUMULATIVE=true
Collection schedule: PERIOD(sec)=60, TRAFFIC=AF1, REPL=2, PATTERN=/cloud/ai/platform/dataplane/prediction/
Map with 0 row(s)