Looks like Assign Background does not copy anchors into the background. I don’t mind this behaviour because anchors in the background are not very useful. However, the result is that if I apply Swap with Background then the anchors are deleted.
So, can I ask to either include anchors in Assign Background or exclude anchors in Swap with Background (or, at least not to delete them if there are none in the background).