Documentation
¶
Overview ¶
Command chainprobe measures whether the call graph makes a chain followable, without an agent in the loop.
The agent A/B cannot answer this. Two identical runs of the same arm on the same repo came back 52.1K and 81.8K variable tokens — a 57% spread, wider than every between-repo difference the A/B was being read for. The spread comes from a discrete choice (how often the model asks for a full body), so more repeats would cost hours to shrink an error bar that a deterministic measurement does not have at all.
What actually makes a chain cheap here is that the next hop arrives with the previous answer: a result carries its callers and callees, so following an edge costs no second search. So that is what this measures. For each consecutive pair in a hand-traced chain, it asks for the first symbol and checks whether the second is already on the page.
covered — the next hop appeared as a graph ref of the queried symbol
sibling — it appeared as another ranked result instead (still free to
follow, but not because of the graph)
missed — neither: the agent has to search again
Source Files