Have you seen this post?
What is your camera currently parented to?
An option is to create a Node2D and put it below your player nodes in the scene tree. Parent the camera to this new Node. Have this node move to location between your players and also set the zoom, if needed.