Turns out, the answer to this is “Raspberry Pi 3”
https://blog.codinghorror.com/the-raspberry-pi-has-revolutionized-emulation/
For reference the $36 Pi 3 has about the same horsepower as a 2012 iPhone 5. The watt budget is a fair bit higher at 4w though – make sure yours comes with a heatsink!