#7194 Fedora-41-20241016.n.0 DOOMED
Closed by jnsamyak. Opened by releng.

pungi.global.log

[ERROR   ] [FAIL] Ostree container (variant Sericea, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878859. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Sericea/ostree-container-6/runroot.log for more details.

Variant: Sericea, subvariant: task failed. Pinging maintainers: @fale @anthr76 @alebastr @jkonecny

[ERROR   ] [FAIL] Ostree container (variant Silverblue, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878862. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Silverblue/ostree-container-9/runroot.log for more details.

Variant: Silverblue, subvariant: task failed. Pinging maintainers: @tpopela @siosm

[ERROR   ] [FAIL] Ostree (variant Sericea, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878869. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Sericea/ostree-6/runroot.log for more details.

Variant: Sericea, subvariant: task failed. Pinging maintainers: @fale @anthr76 @alebastr @jkonecny

[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878855. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Kinoite/ostree-container-3/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[ERROR   ] [FAIL] Ostree (variant Kinoite, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878866. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Kinoite/ostree-3/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[ERROR   ] [FAIL] Ostree (variant Silverblue, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878872. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Silverblue/ostree-9/runroot.log for more details.

Variant: Silverblue, subvariant: task failed. Pinging maintainers: @tpopela @siosm

[ERROR   ] [FAIL] Ostree (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878864. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/Kinoite/ostree-2/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[ERROR   ] [FAIL] Ostree (variant Silverblue, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878870. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/Silverblue/ostree-8/runroot.log for more details.

Variant: Silverblue, subvariant: task failed. Pinging maintainers: @tpopela @siosm

[ERROR   ] [FAIL] Buildinstall (variant Server, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878877. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/buildinstall-Server.ppc64le.log for more details.
[ERROR   ] [FAIL] Ostree container (variant Kinoite, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: 124878854. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/Kinoite/ostree-container-2/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Silverblue, arch aarch64) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 124879778. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Silverblue/ostree_installer-6/runroot.log for more details.

Variant: Silverblue, subvariant: task failed. Pinging maintainers: @tpopela @siosm

[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Kinoite, arch aarch64) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 124879777. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/Kinoite/ostree_installer-1/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Silverblue, arch ppc64le) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 124879772. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/Silverblue/ostree_installer-7/runroot.log for more details.

Variant: Silverblue, subvariant: task failed. Pinging maintainers: @tpopela @siosm

[OSTREE_INSTALLER] [ERROR   ] [FAIL] Ostree installer (variant Kinoite, arch ppc64le) failed, but going on anyway.
[OSTREE_INSTALLER] [ERROR   ] Runroot task failed: 124879774. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/ppc64le/Kinoite/ostree_installer-2/runroot.log for more details.

Variant: Kinoite, subvariant: task failed. Pinging maintainers: @siosm

[ERROR   ] Compose run failed: Runroot task failed: 124878852. See /mnt/koji/compose/branched/Fedora-41-20241016.n.0/logs/aarch64/buildinstall-Everything.aarch64.log for more details.

Compose Total time: 1:45:13
Compose phase INIT time: 0:00:21.
Compose phase PKGSET time: 0:36:34.
Compose phase WEAVER: FAILED.
Compose phase BUILDINSTALL: FAILED.
Compose phase GATHER time: 0:31:14.
Compose phase OSTREE time: 0:28:52.
Compose phase OSTREE_CONTAINER time: 0:40:38.
Compose phase OSTREE_INSTALLER time: 0:39:17.
Compose phase CREATEREPO time: 0:08:00.


This appears to be the same issue that's plaguing ELN composes right now:

DEBUG util.py:553:  Using nspawn with args ['--capability=cap_ipc_lock', '--capability=cap_mac_admin', '--bind=/tmp/mock-resolv.831cc6sl:/etc/resolv.conf']
DEBUG util.py:558:  Executing command: ['/usr/bin/systemd-nspawn', '-q', '-M', '92ea3b6022764bdeac703308f965f3e5', '-D', '/var/lib/mock/eln-build-54284108-6525219-bootstrap/root', '-a', '--capability=cap_ipc_lock', '--capability=cap_mac_admin', '--bind=/tmp/mock-resolv.831cc6sl:/etc/resolv.conf', '--console=pipe', '--setenv=TERM=vt100', '--setenv=SHELL=/bin/bash', '--setenv=HOME=/var/lib/mock/eln-build-54284108-6525219/root/installation-homedir', '--setenv=HOSTNAME=mock', '--setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin', '--setenv=PROMPT_COMMAND=printf "\\033]0;<mock-chroot>\\007"', '--setenv=PS1=<mock-chroot> \\s-\\v\\$ ', '--setenv=LANG=C.UTF-8', '--setenv=LC_MESSAGES=C.UTF-8', '--resolv-conf=off', '/usr/bin/dnf5', '--installroot', '/var/lib/mock/eln-build-54284108-6525219/root/', 'install', '@build', '--setopt=deltarpm=False', '--setopt=allow_vendor_change=yes', '--allowerasing', '--setopt=tsflags=nocontexts'] with env {'TERM': 'vt100', 'SHELL': '/bin/bash', 'HOME': '/var/lib/mock/eln-build-54284108-6525219/root/installation-homedir', 'HOSTNAME': 'mock', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"', 'PS1': '<mock-chroot> \\s-\\v\\$ ', 'LANG': 'C.UTF-8', 'LC_MESSAGES': 'C.UTF-8', 'SYSTEMD_NSPAWN_TMPFS_TMP': '0', 'SYSTEMD_SECCOMP': '0'} and shell False
DEBUG util.py:461:  Failed to register machine: Connection timed out

The buildvm-a64-01/02/03 compose builders were in a weird state. I had updated (and I thought rebooted) everything yesterday before freeze, but those hosts didn't reboot, they just partially rebooted somehow. I destroyed them and restarted them and they seem much happier now.

Metadata Update from @jnsamyak:
- Issue status updated to: Closed (was: Open)

Metadata