A more involved followup to #4309
Related: https://pagure.io/koji/issue/4308
rebased onto 5e1584ec88a159c75adc15a864ffc7e60262ce0d
rebased since #4309 was merged
Metadata Update from @tkopecek: - Pull-request tagged with: no_qe
Commit 75897385 fixes this pull-request
Pull-Request has been merged by tkopecek
Fixes https://pagure.io/koji/issue/4366
A more involved followup to #4309
Related: https://pagure.io/koji/issue/4308