CheckConfigNoReplace is about using %config(noreplace) for config files.
The test should return PENDING on failures and not FAIL as today since the usage might be legitimate. The text needs an overhaul, current message is basically not understandable.
fixed in f3c1ca418d65e721