Question is pretty straightforward. Godot doesn't seem to have a built in function for this.
You can use an AnimationPlayer to animate the AudioStreamPlayer's volume_db property or use a Tween node to do so.
Works like a charm, and very clean. Thanks a lot! I will actually probably use this Tween feature for other parts of the app as well now that I know how it works!