Training agents

A training crawler collects pages to train models; blocking it costs no citations and no readers.