It's supposed to do that, if you want to get rid of it because it getting in your way press the A key again and click outside the texture box that should remove the box (you may have to drag a little), the texture will still be there, just in a box too small to see.