I have my Pan Cam V3 installed in my 3-car garage, it keeps losing waypoint position settings every couple days or so. Wind is not an issue being in the garage when it loses waypoints, it is by a lot! By a lot I mean not even close to what I set. It will go from setting it on four waypoints to look downward to the floor to looking at the ceiling, yes it has the latest firmware update.
This is a known issue with the PanV3. Please refer to this thread for updates on progress in fixing it.
My pan cam has the same behavior. Although it is not a fix, the following procedure is just slightly less annoying then resetting your waypoints. Use the Wyze app controls to move your pan cam all the way to the left, then all the way to the right, then center it, then all the way up and all the way down, Your waypoints will then be accurate again.