I had a discussion along the same lines a while back, originally about getting it out, but led to some talk of putting it back in.

The sheath should be inside the hose, and sometimes (depending on the type) way down in there. You'll have to pull the top of the hose out with your other hand to get it back in right. If not, you're likely wearing it too high.