Greg,
I'm not sure what you mean by a "Yank", but be wary of pulling on the connector wire. Actually, at least on the front, you can remove the two bolts that hold the sensors in the swivel housing. Then, simply take a screwdriver and gently pry underneath the spacer, being careful not to damage the shims underneath. These can be paper-thin sometimes. If the sensors put up any resistance they are probably just corroded/dirty.
Also, now would be the perfect time to check your swivel preload. And, don't forget to reinstall the brake line bracket. Seems like I forget that every time.