If you're not happy with the default Windows file manager, you're in luck because there are plenty of options that improve on the original.
You can pick a custom keyboard shortcut, and you can decide to simply press that shortcut instead of pressing and holding it.