My bad, what I was doing was, I had a CollisionShape2D and then selected a ConvexPolygonShape2D as Shape. How do you edit that then? I saw you can type in vertex coordinates manually, is that the only way? Also, what's the difference between this and using a CollisionPolygon2D?