So I'm just going to put this here since I'm not sure how much of this is a bug/fixable, but it turns out that controls still work for the game even if you open up another window and are doing stuff in that. I'm not sure how much of a problem this is really, but it seems like it might be an annoyance for people who do stuff a bit at a time.