Assigning a Private Use Area to existing glyph?

There is a rule that you should not use encoded glyphs in OpenType features. There are some exemptions but this seems not right.
The ornm feature should not use letters as base characters. Because it will look like and letter in all kinds of places (screen readers, PDF…). Whats wrong with the PUA for ornaments?