I was able to fix this by adjusting the anchor point to the bottom.
If you are using Sprite node:
Just select the sprite node then hold v then move the + sign on the screen to where you want to put the anchor.
Or
Select the sprite node then go to Inspector > Sprite > Offset then adjust the values.
If you are using TileMap:
Edit the tileset > Select the tile > Inspector > Selected Tile > Tex Offset then adjust the values.
Please take note that in my case I was using collision so I also had to adjust the position of those nodes.