If you can see the boot actually moving in and out, you've got play elsewhere. If the bearing were bad, the most you'd get would be some rocking of the shaft-- it wouldn't move in and out. I'd also expect you to have one heck of a humming or rumbling noise when you drive.
The top of the wheel is pretty much fixed in place and won't move due to the strut attachment. With the wheel jacked off the ground, grab the bottom and see if you can pull it in and out. If you can, the problem is likely in the ball joint. Look specifically to see if the control arm pushes up and down when you move the bottom of the wheel in and out.
Similarly, when you rock the wheel from side to side, you should be able to see the tie rod end joint move if that's where the issue is.