PLAY PODCASTS
The Dangers of Measuring Side Effects
Episode 904

The Dangers of Measuring Side Effects

You want to measure what matters. But your measurements might change what matters. Understanding that anything that is measured might modify behaviors, it's important to then understand what should be targeted. How can we incentivize the right actions that produce the side effects we want, rather than incentivizing direct manipulation of those side effects?

Developer Tea

January 4, 202120m 47s

Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Show Notes

You want to measure what matters. But your measurements might change what matters.

 

Understanding that anything that is measured might modify behaviors, it's important to then understand what should be targeted. How can we incentivize the right actions that produce the side effects we want, rather than incentivizing direct manipulation of those side effects?