I'm seeing sporadic 404s for https://getfedora.org/static/keys/53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4.txt when running mkosi's CI in Github Actions (https://github.com/systemd/mkosi/runs/6545964660?check_suite_focus=true#step:7:348). Trying with curl results in the same sporadic 404 error. Assuming the IP belongs to the actual Fedora server, is there anything that might be causing the server to return 404 sporadically? The other scenario is that there's some caching going on inbetween and the IP doesn't actually belong to the original Fedora server. Knowing that would also help me to further debug the issue.
Loading https://getfedora.org/static/keys/53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4.txt from my laptop, I don't see any 404s and can correctly access the key in a browser.
Example failure:
Fedora 36 - base 44 kB/s | 15 kB 00:00 Fedora 36 - updates 36 kB/s | 11 kB 00:00 Dependencies resolved. ================================================================================ Package Arch Version Repo Size ================================================================================ Installing: fedora-release noarch 36-17 fedora 12 k systemd x86_64 250.3-8.fc36 fedora 4.3 M util-linux x86_64 2.38-0.2.fc36 fedora 2.2 M Installing dependencies: alternatives x86_64 1.19-2.fc36 fedora 36 k audit-libs x86_64 3.0.8-1.fc36 fedora 116 k authselect x86_64 1.4.0-1.fc36 updates 139 k authselect-libs x86_64 1.4.0-1.fc36 updates 234 k basesystem noarch 11-13.fc36 fedora 7.0 k bash x86_64 5.1.16-2.fc36 fedora 1.7 M bzip2-libs x86_64 1.0.8-11.fc36 fedora 41 k ca-certificates noarch 2021.2.52-3.fc36 fedora 367 k coreutils x86_64 9.0-5.fc36 fedora 1.1 M coreutils-common x86_64 9.0-5.fc36 fedora 2.0 M cracklib x86_64 2.9.6-28.fc36 fedora 81 k crypto-policies noarch 20220203-2.git112f859.fc36 fedora 58 k dbus x86_64 1:1.14.0-1.fc36 fedora 7.5 k dbus-broker x86_64 31-1.fc36 updates 176 k dbus-common noarch 1:1.14.0-1.fc36 fedora 14 k expat x86_64 2.4.7-1.fc36 fedora 109 k fedora-gpg-keys noarch 36-1 fedora 114 k fedora-release-common noarch 36-17 fedora 21 k fedora-release-identity-basic noarch 36-17 fedora 12 k fedora-repos noarch 36-1 fedora 10 k filesystem x86_64 3.16-2.fc36 fedora 1.1 M gawk x86_64 5.1.1-2.fc36 fedora 1.0 M glibc x86_64 2.35-9.fc36 updates 2.1 M glibc-common x86_64 2.35-9.fc36 updates 328 k glibc-minimal-langpack x86_64 2.35-9.fc36 updates 52 k gmp x86_64 1:6.2.1-2.fc36 fedora 315 k grep x86_64 3.7-2.fc36 fedora 263 k gzip x86_64 1.11-3.fc36 fedora 156 k keyutils-libs x86_64 1.6.1-4.fc36 fedora 31 k kmod-libs x86_64 29-7.fc36 fedora 68 k krb5-libs x86_64 1.19.2-9.fc36 updates 722 k libacl x86_64 2.3.1-3.fc36 fedora 24 k libattr x86_64 2.5.1-4.fc36 fedora 18 k libblkid x86_64 2.38-0.2.fc36 fedora 107 k libcap x86_64 2.48-4.fc36 fedora 67 k libcap-ng x86_64 0.8.2-9.fc36 fedora 33 k libcom_err x86_64 1.46.5-2.fc36 fedora 25 k libdb x86_64 5.3.28-51.fc36 fedora 766 k libeconf x86_64 0.4.0-3.fc36 fedora 27 k libfdisk x86_64 2.38-0.2.fc36 fedora 158 k libffi x86_64 3.4.2-8.fc36 fedora 37 k libgcc x86_64 12.1.1-1.fc36 updates 103 k libgcrypt x86_64 1.10.1-2.fc36 updates 510 k libgpg-error x86_64 1.45-1.fc36 updates 221 k libmount x86_64 2.38-0.2.fc36 fedora 135 k libnsl2 x86_64 2.0.0-3.fc36 fedora 30 k libpwquality x86_64 1.4.4-7.fc36 fedora 104 k libseccomp x86_64 2.5.3-2.fc36 fedora 70 k libselinux x86_64 3.3-4.fc36 fedora 85 k libsemanage x86_64 3.3-3.fc36 fedora 119 k libsepol x86_64 3.3-3.fc36 fedora 309 k libsigsegv x86_64 2.14-2.fc36 fedora 27 k libsmartcols x86_64 2.38-0.2.fc36 fedora 64 k libtasn1 x86_64 4.18.0-2.fc36 fedora 75 k libtirpc x86_64 1.3.2-1.rc1.fc36.1 fedora 94 k libutempter x86_64 1.2.1-6.fc36 fedora 26 k libuuid x86_64 2.38-0.2.fc36 fedora 28 k libverto x86_64 0.3.2-3.fc36 fedora 21 k libxcrypt x86_64 4.4.28-1.fc36 fedora 119 k libzstd x86_64 1.5.2-1.fc36 fedora 295 k lz4-libs x86_64 1.9.3-4.fc36 fedora 70 k mpfr x86_64 4.1.0-9.fc36 fedora 333 k ncurses-base noarch 6.2-9.20210508.fc36 fedora 60 k ncurses-libs x86_64 6.2-9.20210508.fc36 fedora 326 k openssl-libs x86_64 1:3.0.2-5.fc36 updates 2.1 M p11-kit x86_64 0.24.1-2.fc36 fedora 362 k p11-kit-trust x86_64 0.24.1-2.fc36 fedora 138 k pam x86_64 1.5.2-12.fc36 fedora 519 k pam-libs x86_64 1.5.2-12.fc36 fedora 59 k pcre x86_64 8.45-1.fc36.1 fedora 203 k pcre2 x86_64 10.40-1.fc36 updates 237 k pcre2-syntax noarch 10.40-1.fc36 updates 143 k popt x86_64 1.18-7.fc36 fedora 59 k readline x86_64 8.1-6.fc36 fedora 211 k sed x86_64 4.8-10.fc36 fedora 297 k setup noarch 2.13.10-1.fc36 updates 143 k shadow-utils x86_64 2:4.11.1-2.fc36 fedora 1.1 M systemd-libs x86_64 250.3-8.fc36 fedora 615 k systemd-pam x86_64 250.3-8.fc36 fedora 334 k tzdata noarch 2022a-2.fc36 updates 432 k util-linux-core x86_64 2.38-0.2.fc36 fedora 454 k xz-libs x86_64 5.2.5-9.fc36 fedora 92 k zlib x86_64 1.2.11-31.fc36 fedora 91 k Transaction Summary ================================================================================ Install 86 Packages Total size: 31 M Installed size: 100 M Downloading Packages: [SKIPPED] alternatives-1.19-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] audit-libs-3.0.8-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] basesystem-11-13.fc36.noarch.rpm: Already downloaded [SKIPPED] bash-5.1.16-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] bzip2-libs-1.0.8-11.fc36.x86_64.rpm: Already downloaded [SKIPPED] ca-certificates-2021.2.52-3.fc36.noarch.rpm: Already downloaded [SKIPPED] coreutils-9.0-5.fc36.x86_64.rpm: Already downloaded [SKIPPED] coreutils-common-9.0-5.fc36.x86_64.rpm: Already downloaded [SKIPPED] cracklib-2.9.6-28.fc36.x86_64.rpm: Already downloaded [SKIPPED] crypto-policies-20220203-2.git112f859.fc36.noarch.rpm: Already downloaded [SKIPPED] dbus-1.14.0-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] dbus-common-1.14.0-1.fc36.noarch.rpm: Already downloaded [SKIPPED] expat-2.4.7-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] fedora-gpg-keys-36-1.noarch.rpm: Already downloaded [SKIPPED] fedora-release-36-17.noarch.rpm: Already downloaded [SKIPPED] fedora-release-common-36-17.noarch.rpm: Already downloaded [SKIPPED] fedora-release-identity-basic-36-17.noarch.rpm: Already downloaded [SKIPPED] fedora-repos-36-1.noarch.rpm: Already downloaded [SKIPPED] filesystem-3.16-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] gawk-5.1.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] gmp-6.2.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] grep-3.7-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] gzip-1.11-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] keyutils-libs-1.6.1-4.fc36.x86_64.rpm: Already downloaded [SKIPPED] kmod-libs-29-7.fc36.x86_64.rpm: Already downloaded [SKIPPED] libacl-2.3.1-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libattr-2.5.1-4.fc36.x86_64.rpm: Already downloaded [SKIPPED] libblkid-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libcap-2.48-4.fc36.x86_64.rpm: Already downloaded [SKIPPED] libcap-ng-0.8.2-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] libcom_err-1.46.5-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libdb-5.3.28-51.fc36.x86_64.rpm: Already downloaded [SKIPPED] libeconf-0.4.0-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libfdisk-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libffi-3.4.2-8.fc36.x86_64.rpm: Already downloaded [SKIPPED] libmount-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libnsl2-2.0.0-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libpwquality-1.4.4-7.fc36.x86_64.rpm: Already downloaded [SKIPPED] libseccomp-2.5.3-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libselinux-3.3-4.fc36.x86_64.rpm: Already downloaded [SKIPPED] libsemanage-3.3-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libsepol-3.3-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libsigsegv-2.14-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libsmartcols-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libtasn1-4.18.0-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libtirpc-1.3.2-1.rc1.fc36.1.x86_64.rpm: Already downloaded [SKIPPED] libutempter-1.2.1-6.fc36.x86_64.rpm: Already downloaded [SKIPPED] libuuid-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libverto-0.3.2-3.fc36.x86_64.rpm: Already downloaded [SKIPPED] libxcrypt-4.4.28-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] libzstd-1.5.2-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] lz4-libs-1.9.3-4.fc36.x86_64.rpm: Already downloaded [SKIPPED] mpfr-4.1.0-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] ncurses-base-6.2-9.20210508.fc36.noarch.rpm: Already downloaded [SKIPPED] ncurses-libs-6.2-9.20210508.fc36.x86_64.rpm: Already downloaded [SKIPPED] p11-kit-0.24.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] p11-kit-trust-0.24.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] pam-1.5.2-12.fc36.x86_64.rpm: Already downloaded [SKIPPED] pam-libs-1.5.2-12.fc36.x86_64.rpm: Already downloaded [SKIPPED] pcre-8.45-1.fc36.1.x86_64.rpm: Already downloaded [SKIPPED] popt-1.18-7.fc36.x86_64.rpm: Already downloaded [SKIPPED] readline-8.1-6.fc36.x86_64.rpm: Already downloaded [SKIPPED] sed-4.8-10.fc36.x86_64.rpm: Already downloaded [SKIPPED] shadow-utils-4.11.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] systemd-250.3-8.fc36.x86_64.rpm: Already downloaded [SKIPPED] systemd-libs-250.3-8.fc36.x86_64.rpm: Already downloaded [SKIPPED] systemd-pam-250.3-8.fc36.x86_64.rpm: Already downloaded [SKIPPED] util-linux-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] util-linux-core-2.38-0.2.fc36.x86_64.rpm: Already downloaded [SKIPPED] xz-libs-5.2.5-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] zlib-1.2.11-31.fc36.x86_64.rpm: Already downloaded [SKIPPED] authselect-1.4.0-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] authselect-libs-1.4.0-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] dbus-broker-31-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] glibc-2.35-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] glibc-common-2.35-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] glibc-minimal-langpack-2.35-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] krb5-libs-1.19.2-9.fc36.x86_64.rpm: Already downloaded [SKIPPED] libgcc-12.1.1-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] libgcrypt-1.10.1-2.fc36.x86_64.rpm: Already downloaded [SKIPPED] libgpg-error-1.45-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] openssl-libs-3.0.2-5.fc36.x86_64.rpm: Already downloaded [SKIPPED] pcre2-10.40-1.fc36.x86_64.rpm: Already downloaded [SKIPPED] pcre2-syntax-10.40-1.fc36.noarch.rpm: Already downloaded [SKIPPED] setup-2.13.10-1.fc36.noarch.rpm: Already downloaded [SKIPPED] tzdata-2022a-2.fc36.noarch.rpm: Already downloaded Fedora 36 - base 1.1 kB/s | 260 B 00:00 Status code: 404 for https://getfedora.org/static/keys/53DED2CB922D8B8D9E63FD18999F7CBF38AB71F4.txt (IP: 35.81.0.97)
One of our proxies (proxy09) is currently being moved to aws and seems like it's not completely deployed yet.
Alright, can you post here when the deployment is complete? That gives us an idea when we can expect these errors to disappear.
The problem was that the proxy didn't get removed from DNS in all fields. I have removed it.
Closing as primary problem is fixed.
Metadata Update from @smooge: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)