In investgating #3562, i discovered that even though we show the quick replies settings if PR's are open, and issues are closed on a project, actually trying to change or add a quick reply results in a 404 saying the issue tracker is closed for a project.
Commit 6800cd65 fixes this issue