---
title: "Measuring agents is the next essential skill"
date: 2026-09-07
canonical: https://solmaz.io/x/2097011426636542048/
x_url: https://x.com/onusoz/status/2097011426636542048
license: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)
---

Can we show my wife @qrlow some love 🤗🤗🤗

She's just started dipping her toes in evaluating LLMs in her own field

I helped her out just with running the benchmark and she solved some of the issues pretty creatively, like how to come up with synthetic tasks that match what usually happens inside a trading house 

She is on Hugging Face too 🤗 No better place than to publish a benchmark

I have been encouraging all my close circle to go towards benchmarking models as well

Literally every company that uses AI in any way will have to measure their performance, on internal metrics

Especially if they start leveraging their data, training their own models and such

So every employee will benefit from such know-how

The most important one that comes after knowing how to use agents is knowing how to measure them

If you are worried of becoming obsolete, one of the highest leverage things you could learn to do would be to try out running some benchmarks, learn what @harborframework does, converting your own companies' mundane tasks into evals, and so on

*Quotes a post by @qrlow (https://x.com/qrlow/status/2097006227381477451); its text is omitted here because it is not covered by this site's license.*