dusty / failed-composes

#960 Fedora-Rawhide-20181102.n.0 DOOMED
Opened by dustymabe. Modified

Open
Close Issue

pungi.global.log

  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree (variant AtomicHost, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: None. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/x86_64/AtomicHost/ostree-3/runroot.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree (variant Silverblue, arch x86_64) failed, but going on anyway.
[ERROR   ] Runroot task failed: None. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/x86_64/Silverblue/ostree-4/runroot.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree (variant AtomicHost, arch aarch64) failed, but going on anyway.
[ERROR   ] Runroot task failed: None. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/aarch64/AtomicHost/ostree-1/runroot.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Ostree (variant AtomicHost, arch ppc64le) failed, but going on anyway.
[ERROR   ] Runroot task failed: None. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/ppc64le/AtomicHost/ostree-2/runroot.log for more details.

[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Workstation, arch armhfp, subvariant Workstation) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 30605902. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/armhfp/liveimage-Fedora-Workstation-armhfp-Rawhide-20181102.n.0.armhfp.log for more details.

[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant Mate) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 30605866. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/armhfp/liveimage-Fedora-Mate-armhfp-Rawhide-20181102.n.0.armhfp.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Design_suite) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605858. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Design_suite.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Security) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605886. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Security.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Games) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605875. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Games.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Scientific_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605868. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Scientific_KDE.i386-x86_64.log for more details.

[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant SoaS) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 30605878. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/armhfp/liveimage-Fedora-SoaS-armhfp-Rawhide-20181102.n.0.armhfp.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Robotics) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605899. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Robotics.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Python_Classroom) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605903. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Python_Classroom.i386-x86_64.log for more details.

[LIVE_IMAGES     ] [ERROR   ] [FAIL] Live (variant Spins, arch armhfp, subvariant LXQt) failed, but going on anyway.
[LIVE_IMAGES     ] [ERROR   ] LiveImage task failed: 30605896. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/armhfp/liveimage-Fedora-LXQt-armhfp-Rawhide-20181102.n.0.armhfp.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant SoaS) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605915. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-SoaS.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Cinnamon) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605921. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-Cinnamon.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Mate) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605930. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-Mate.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant LXDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605925. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-LXDE.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant Xfce) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605913. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-Xfce.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Jam_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605895. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Jam_KDE.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Spins, arch *, subvariant LXQt) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605931. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Spins-LXQt.i386-x86_64.log for more details.

[LIVE_MEDIA      ] [ERROR   ] [FAIL] Live media (variant Labs, arch *, subvariant Astronomy_KDE) failed, but going on anyway.
[LIVE_MEDIA      ] [ERROR   ] Live media task failed: 30605850. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/livemedia-Labs-Astronomy_KDE.i386-x86_64.log for more details.

[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Spins, arch *, subvariant Minimal) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 30605907. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/aarch64/imagebuild-Spins-Minimal-raw-xz.aarch64.log for more details.

[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Workstation, arch *, subvariant Workstation) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 30605910. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/aarch64/imagebuild-Workstation-Workstation-raw-xz.aarch64.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant AtomicHost, arch ppc64le, subvariant AtomicHost) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant AtomicHost, arch aarch64, subvariant AtomicHost) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant AtomicHost, arch aarch64, subvariant AtomicHost) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-AtomicHost/Rawhide/20181102.n.0/images/Fedora-AtomicHost-Rawhide-20181102.n.0.x86_64.qcow2 to /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/compose/AtomicHost/x86_64/images/Fedora-AtomicHost-Rawhide-20181102.n.0.x86_64.qcow2

[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Server, arch *, subvariant Server) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 30605904. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/aarch64/imagebuild-Server-Server-raw-xz.aarch64.log for more details.

[IMAGE_BUILD     ] [ERROR   ] [FAIL] Image build (variant Labs, arch *, subvariant Scientific) failed, but going on anyway.
[IMAGE_BUILD     ] [ERROR   ] ImageBuild task failed: 30605897. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/i386-x86_64/imagebuild-Labs-Scientific-vagrant-libvirt-vagrant-virtualbox.i386-x86_64.log for more details.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Minimal_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch aarch64, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch aarch64, subvariant Container_Minimal_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Minimal_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Minimal_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Minimal_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Minimal-Base/Rawhide/20181102.n.0/images/Fedora-Container-Minimal-Base-Rawhide-20181102.n.0.x86_64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/compose/Container/x86_64/images/Fedora-Container-Minimal-Base-Rawhide-20181102.n.0.x86_64.tar.xz
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch ppc64le, subvariant Container_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch s390x, subvariant Container_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch armhfp, subvariant Container_Base) failed, but going on anyway.
[ERROR   ] [FAIL] Image build (variant Container, arch aarch64, subvariant Container_Base) failed, but going on anyway.
  • No Task ID, look at log statement
[ERROR   ] [FAIL] Image build (variant Container, arch aarch64, subvariant Container_Base) failed, but going on anyway.
[IMAGE_BUILD     ] [INFO    ] Hardlinking /mnt/koji/packages/Fedora-Container-Base/Rawhide/20181102.n.0/images/Fedora-Container-Base-Rawhide-20181102.n.0.x86_64.tar.xz to /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/compose/Container/x86_64/images/Fedora-Container-Base-Rawhide-20181102.n.0.x86_64.tar.xz
  • Compose run failed because: - 30605857
[ERROR   ] Compose run failed: ImageBuild task failed: 30605857. See /mnt/koji/compose/rawhide/Fedora-Rawhide-20181102.n.0/logs/aarch64-ppc64le-s390x-x86_64/imagebuild-Cloud-Cloud_Base-qcow2-raw-xz.aarch64-ppc64le-s390x-x86_64.log for more details.

I have some info on the live fails, at least. I reproduced one in a local mock. It seems like pylorax fails to find any kernels because, well, there really aren't any - the expected /boot/vmlinuz-4.20.0-0.rc0.git8.1.fc30.x86_64 is just MIA, it's not there.

Looking into the mechanism a bit, I think the kernel package does not actually install this file, exactly. It seems to actually install the kernel file as /lib/modules/4.20.0-0.rc0.git8.1.fc30.x86_64/vmlinuz and then calls /bin/kernel-install in %posttrans, and that is expected to copy it to /boot...only it seems like when this fails, it doesn't do that.

I've tried reinstalling the kernel-core package in the filesystem image from my live compose attempt several times, and each time the result is the same - no /boot/vmlinuz-4.20.0-0.rc0.git8.1.fc30.x86_64 shows up.

I also tested a network install of Rawhide from the 1021.n.0 network install image with a side repo containing the kernel-4.20.0-0.rc0.git8.1.fc30 packages, and that worked OK - it does get a /boot/vmlinuz-4.20.0-0.rc0.git8.1.fc30.x86_64 file.

I don't yet know what the difference is that makes this sometimes (often) fail for live image composes yet, or what suddenly changed...

I think the problem is that /usr/lib/kernel/install.d/20-grub.install is bailing here:

 if ! [[ $KERNEL_INSTALL_MACHINE_ID ]]; then
    exit 0
fi

i.e. $KERNEL_INSTALL_MACHINE_ID is not set. I don't know what's supposed to set that, and why it's not working.

Seems the problem is that /etc/machine-id was empty. It's supposed to be set up by a call to systemd-machine-id-setup in systemd's scriptlets...I don't know why that failed, or bailed. It's done like this:

systemd-machine-id-setup &>/dev/null || :

so failures are masked and not logged :/

I believe I've got it, thanks to hacking up the systemd package scripts a bit:

systemd-machine-id-setup: error while loading shared libraries: libssl.so.1.1: cannot open shared object file: No such file or directory

looks like when systemd %post runs, openssl-libs is not installed, in affected live builds. (So the ones that worked likely worked because openssl-libs happened to get installed ahead of systemd for some reason; package install ordering in ambiguous situations is a very complex beast and not really worth digging into very far, we should just add the missing dep.)
Metadata
None
None
None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.