releng

#11969 Fedora Atomic Desktops composes are failing for F40 & Rawhide as they include "external" repos
Closed: Fixed by siosm. Opened by siosm.

Closed: Fixed
Reopen Issue
  • Describe the issue

All Fedora Atomic Desktop composes are failing for Fedora 40 & Rawhide since Feb 13/14.

Looking at the logs, it appears that the repositories defined in the manifests are no longer overridden by the ones used for the composes and thus rpm-ostree tries to reach out over the network and times out.

Fedora 40:
- https://pagure.io/releng/failed-composes/issue/5963
- https://koji.fedoraproject.org/koji/taskinfo?taskID=113733830
- https://kojipkgs.fedoraproject.org//work/tasks/3830/113733830/runroot.log

Enabled rpm-md repositories: fedora-40-updates fedora-40 repo-0 repo-1
Updating metadata for 'fedora-40-updates'...done
error: Updating rpm-md repo 'fedora-40-updates': cannot update repo 'fedora-40-updates': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (28): Timeout was reached for http://dl.iad2.fedoraproject.org/pub/fedora/linux/updates/40/Everything/x86_64/repodata/repomd.xml [Failed to connect to dl.iad2.fedoraproject.org port 80 after 30000 ms: Timeout was reached]

Which is incorrect as only the repo-* repositories should be there during the Fedora composes and not the ones defined in the manifests.

This started happening right after branching so there is likely something we missed during branching.

Same thing for Rawhide: https://kojipkgs.fedoraproject.org//work/tasks/4602/113784602/runroot.log

  • When do you need this? (YYYY/MM/DD)

As soon as possible, ideally before Fedora 40 beta freeze (2024-02-27).

  • When is this no longer needed or useful? (YYYY/MM/DD)

N/A

  • If we cannot complete your request, what is the impact?

No Atomic desktops for Fedora 40+.

Yeah, need to sort this. The updates repos should be there as just empty repos... but something isn't right. ;(

Metadata Update from @kevin:
- Issue tagged with: medium-gain, medium-trouble, ops

Thinking about this more, I think it's due to https://pagure.io/workstation-ostree-config/pull-request/466. I'll revert it.

Reverts in:
- https://pagure.io/workstation-ostree-config/pull-request/476
- https://pagure.io/workstation-ostree-config/pull-request/477

hah, I just randomly started looking into this and came to the same conclusion.

I think the problem is this tweak_treeconf bit of Pungi. That fiddles with the repo definitions, including ditching original ones if keep_original_sources is False (which is the default). It's called from here, where the file it's running on is self.treefile, which is self.args.treefile, which means it's probably the thing passed as --treefile on the command line, which in the example failed job above was --treefile=/mnt/koji/compose/branched/Fedora-40-20240219.n.0/work/ostree-1/config_repo/fedora-kinoite.yaml. So, yeah, that won't work if we move the repo definitions out of those files, it needs adjusting.

Thanks for the confirmation. I merged the reverts. I'll look at what can be done in Pungi to make this work but this might be for later. I'll close this issue once we have a successful compose.

We got builds for Fedora 40 so looks good. Let's see Rawhide tomorrow.

Hum, we don't have builds of Rawhide and F40 failed today.

This was due to the koji db doom I am pretty sure. :) Hopefully tomorrow...

Looks good. Closing. Thanks and sorry for the noise.

silverblue  38               39               40               rawhide
x86_64      38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
aarch64     38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
ppc64le     38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
kinoite     38               39               40               rawhide
x86_64      38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
aarch64     38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
ppc64le     38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
sericea     38               39               40               rawhide
x86_64      38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
aarch64     38.20240224.0    39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0
onyx        38               39               40               rawhide
x86_64                       39.20240224.0    40.20240224.n.0  Rawhide.20240223.n.0

Metadata Update from @siosm:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
Metadata
None

medium-gain medium-trouble ops

None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.