I think you should use some interpolation somewhere in your code, I never done it by myself so you’ll have to do it on your own
Here is the doc for you:
Where target is the point (in global cooridnates) you want to look at. You can multiply delta by some value to make it faster/slower. You can use local coordinates instead of global, whatever suits your needs.