Using "Confirm" button defaults cursor to "No" on Yes/No prompts

[DJ-RK]

I've recently found the benefit to using the Confirm button to initiate conversations, start actions, etc rather than clicking on everything (and have even bound one of the keys on my mouse to it for even easier use of it), which can really help save time and reduce effort for mundane things, but I've got a pet peeve which is when pressing Confirm on something that brings up a horizontal "Yes" or "No" dialogue prompt (like, say, the entrance to the Rising Stones), the selection cursor always defaults to "No." This then requires me to either press the left arrow key to move it to "Yes" or to have click on Yes instead (needing to move my mouse cursor to do so, usually from way off on the right side of the screen to center). If it would just default to "Yes" then I'd only have to press the confirm button twice in a row, but as it stands it completely and unnecessarily ruins an otherwise great quality of life tool.

Has anyone else found this to be the case and figured out a proper solution to it?