Used to work at a pretty secure place. Each button had a small screen on it, and the numbers were randomized. So apparently this is an actual concern.