Related: https://pagure.io/koji/issue/2119
rebased onto 4e943eae7362598603ba4c6f106b0b1f99445a58
Ok, it appears that regenRepos is the only consumer of the data gathered by checkTasks (apart from printState, which is purely informative). So, in that sense, it seems reasonable to move this here.
regenRepos
checkTasks
printState
On the other hand, regenRepos was was isolated to try to remove as much slowdown from the regen cycle as possible. I'm a little concerned that putting checkTasks here could have the opposite effect that intended in some cases. The getTaskInfo multicall shouldn't take very long, but the listTasks could in some instances be very slow.
getTaskInfo
listTasks
Using this reraises older issue which was thought to be fixed #942. It show up more or less regularly with this patch. Not sure what is the code causing it. Even with recent_tasks_lifetime: long enough it still shows up. It will get cleared few cycles ahead when tags are updated. But meanwhile it spawns additional tasks (I've put simple continue in that part to not create secondary task as it is evidently done)
recent_tasks_lifetime:
continue
$ grep 33027713 /var/log/kojira.log 2020-11-11 13:11:59,314 [INFO] koji.repo.regen: Created newRepo task 33027713 for tag 65604 (rhel-7.9-z-nss-stack-build), expired for 160.3 sec 2020-11-11 13:17:12,659 [INFO] koji.repo.regen: Finished: newRepo task 33027713 for tag 65604 2020-11-11 14:17:18,584 [WARNING] koji: Needed tag refers to unknown task. rhel-7.9-z-nss-stack-build -> 33027713
1 new commit added
remove recent tasks behaviour
It looks that fix could be to remove tag from needed_tags if task successfully finished. In such case it should be ok (in worst case it will be checked in next cycle, but it looks less harmful than triggerring duplicate tasks).
allow other thread to remove tag
rebased onto 934ca61381d69f6cd36c216eff5eca7b3de4fa27
remove unused variable
Metadata Update from @tkopecek: - Pull-request tagged with: testing-ready
rebased onto fcf84dd6221bf1773b861baf1ce421dc983681be
New issue for release #2581
Metadata Update from @tkopecek: - Pull-request untagged with: testing-ready - Pull-request tagged with: no_qe
I'm not 100% sure what problem we are trying to solve here.
I see that this is a followup to #2119. In that ticket, Kevin writes that the fix worked, but that Kojira was still "not functioning well". However, I don't see any details there or in that issue or in #2581.
I am concerned about dismantling this race condition fix.
Is there a problem statement somewhere that I am missing?
@kevin Are you still running this PR? Do you've hit some problems with it?
Commit 1fed5e44 fixes this pull-request
Pull-Request has been merged by tkopecek
So we ran this for a while, but then went back to without it.
I think our issues were not related to this change...
Related: https://pagure.io/koji/issue/2119