Yes, the camera’s standard pixel motion detection is sensitive to anything that makes the live feed picture change.
I would recommend trying a PIR motion sensor (part of the sense series). As long as the shadows don’t create a noticeable change in surface heat, they should help quite a bit with shadows, tree branches, etc. You may need to block their view from other heat sources, like children next door, lawn mowers, and cars of the street, though.