Not being able to remember the fact that $ has special meaning in replacement patterns is really untypical. I understand mixing up $` and $_ for people w/o Perl background, but just forgetting the whole fact...
All in all, I think it's about not using a feature often enough to remember.