I launched Godot from command prompt, rather than changing my default terminal. That seemed to work.
I also did this:
make a copy of the Command Prompt Shortcut that's in
"%APPDATA%\Microsoft\Windows\Start Menu\Programs\System Tools"
In the properties of the new Shortcut, change the Target to be
%windir%\system32\cmd.exe /c "C:\Program Files\Godot\Godot_v3.4.2-stable_win64.exe"
If I just create a normal shortcut I still get issues, the above worked for me.