releng

#12198 Migrate ELN away from ODCS
Closed: Fixed by sgallagh. Opened by sgallagh.

Closed: Fixed
Reopen Issue

Describe the issue

Fedora Infrastructure wants to decommission ODCS and has been holding onto it for a while longer because ELN is still using it. We need to transition to using the same compose mechanism that Fedora is using.

I'd like to set up a meeting within the next two weeks to hash out what we (ELN SIG) can do and what help we'll need from Releng/Infra that we will need to schedule.

Considerations:

  • Right now, users are consuming the composes directly from https://odcs.fedoraproject.org/composes/production/latest-Fedora-ELN/. Ideally, when we turn off the ODCS composes, we would replace the URLs with redirects to the new locations (in addition to updating the repo definitions in fedora-repos-eln and mock-core-configs).

Stretch goals:

  • We would like to start doing proper "compose gating", so our ideal situation would be for the composes to be built into one path and then basic testing done to move it to a "production" location. As an MVP, that testing could be just "Was it doomed/canceled?", but down the line we'd really like to tie it to OpenQA.

When do you need this? (YYYY/MM/DD)

Our goal is to have this in place by the end of Aug. 2024. The ELN SIG intends to do most of the work, but we need guidance from Fedora Release Engineering to get it right.

When is this no longer needed or useful? (YYYY/MM/DD)

N/A

If we cannot complete your request, what is the impact?

Fedora Infrastructure needs to keep ODCS limping along.

/cc @yselkowitz @tdawson

Metadata Update from @phsmoura:
- Issue tagged with: medium-gain, medium-trouble, ops

I would love to see this happen so we can retire ODCS. ;)

I think whats needed really is:

  • we make a compose-eln01 vm.
  • On that vm there's a cron that pulls from pungi-fedora and runs composes. (just like rawhide does on compose-rawhide01)
  • composes go to /mnt/koji/compose/eln/whatever
  • composes are synced to master mirrors somewhere

and yeah, we should be able to redirect odcs.
I think there's also a small number of people who rsync this content, we will want to make sure to give them a heads up if we can.

Metadata Update from @zlopez:
- Issue untagged with: medium-trouble, ops

Metadata Update from @zlopez:
- Issue tagged with: medium-trouble, ops

The next plan is:

  • Fedora infra team will provide compose-eln01 vm
  • ELN team will prepare nightly compose script
  • Fedora infra team will provide IPs and contact for those rsyncing the ELN compose
  • ELN team announce that they will move away from ODCS

I have created a compose-eln01.iad2.fedoraproject.org host.
I have created a sysadmin-eln group with @sgallagh as manager and member.

You will need to configure ssh as per https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/sshaccess/ to get there.

Do be careful on that host as it's setup as the other compose hosts, so it has access to nfs volumes, etc. The sysadmin-eln group should also be kept small for this same reason.

I have created a compose-eln01.iad2.fedoraproject.org host.
I have created a sysadmin-eln group with @sgallagh as manager and member.

Thank you very much.

You will need to configure ssh as per https://docs.fedoraproject.org/en-US/infra/sysadmin_guide/sshaccess/ to get there.

Yep, I've got that set up already for ODCS, but @yselkowitz will may need to do it as well. Speaking of which:

Do be careful on that host as it's setup as the other compose hosts, so it has access to nfs volumes, etc. The sysadmin-eln group should also be kept small for this same reason.

Understood; for now I'm going to limit it to myself and Yaakov.

Progress is being made here and I've got a prototype up at https://pagure.io/pungi-fedora/pull-request/1304

Small issue I noticed: /usr/bin/pungi-fedmsg-notification and /usr/bin/pungi-wait-for-signed-ostree-handler are not present on the compose VM. I'm not sure if we need the latter immediately (we're not doing ostree builds and may never; we'll likely look at bootc eventually). But the fedmsg notification helper is probably important.

Installed pungi-utils there. It was just a conditional that wasn't matching...

mock-core-configs still needs to be updated, shipped, and deployed to copr before ODCS can go away

mock-core-configs-41.4-1 contains the updated ELN repos and has been shipped across all stable branches, I'm just not sure how to test if it's been deployed to copr.

I can confirm that COPR builds of ELN are working, so I think we're good.

Metadata Update from @sgallagh:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
Metadata
None

medium-gain medium-trouble ops

None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.