When weeding, the best way to make sure you are removing a weed and not a valuable plant is to pull on it.  If it comes out of the ground easily, it is a valuable plant. [source]