Additionally, I did set
Scope of Rebuild Link Previews entry
to All
, but this doesn't change the front-end behavior, it only updates all previews if using the ACP rebuild tool (which causes one issue mentioned above).