koji

#1770 series of errors after upgrading to 1.19
Closed: Duplicate by tkopecek. Opened by jflorian.

Closed: Duplicate
Reopen Issue

My web UI seems adversely affected since the upgrade. If I click on the Builds tab, I get the following logged:

[Wed Nov 06 16:01:11.378984 2019] [:error] [pid 10872] 2019-11-06 16:01:11,378 [ERROR] m=listUsers u=None p=10872 r=10.201.64.55:58868 koji.db: Query failed. Query was: 
[Wed Nov 06 16:01:11.379070 2019] [:error] [pid 10872] SELECT id, array_remove(array_agg(krb_principal), NULL), name, status, usertype
[Wed Nov 06 16:01:11.379080 2019] [:error] [pid 10872]   FROM users
[Wed Nov 06 16:01:11.379087 2019] [:error] [pid 10872]   LEFT JOIN user_krb_principals ON users.id = user_krb_principals.user_id
[Wed Nov 06 16:01:11.379093 2019] [:error] [pid 10872]  WHERE (usertype = 0)
[Wed Nov 06 16:01:11.379100 2019] [:error] [pid 10872]  GROUP BY users.id
[Wed Nov 06 16:01:11.379106 2019] [:error] [pid 10872]  ORDER BY name
[Wed Nov 06 16:01:11.379111 2019] [:error] [pid 10872] 
[Wed Nov 06 16:01:11.379117 2019] [:error] [pid 10872]  
[Wed Nov 06 16:01:11.379123 2019] [:error] [pid 10872] 
[Wed Nov 06 16:01:11.379236 2019] [:error] [pid 10872] 378 [ERROR] m=None u=None p=10872 r=?:? koji.db: Query failed. Query was: 
[Wed Nov 06 16:01:11.379249 2019] [:error] [pid 10872] SELECT id, array_remove(array_agg(krb_principal), NULL), name, status, usertype
[Wed Nov 06 16:01:11.379255 2019] [:error] [pid 10872]   FROM users
[Wed Nov 06 16:01:11.379261 2019] [:error] [pid 10872]   LEFT JOIN user_krb_principals ON users.id = user_krb_principals.user_id
[Wed Nov 06 16:01:11.379268 2019] [:error] [pid 10872]  WHERE (usertype = 0)
[Wed Nov 06 16:01:11.379274 2019] [:error] [pid 10872]  GROUP BY users.id
[Wed Nov 06 16:01:11.379280 2019] [:error] [pid 10872]  ORDER BY name
[Wed Nov 06 16:01:11.379286 2019] [:error] [pid 10872] 
[Wed Nov 06 16:01:11.379292 2019] [:error] [pid 10872]  
[Wed Nov 06 16:01:11.379298 2019] [:error] [pid 10872] 
[Wed Nov 06 16:01:11.385749 2019] [:error] [pid 10872] 2019-11-06 16:01:11,385 [WARNING] m=listUsers u=None p=10872 r=10.201.64.55:58868 koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:01:11.385779 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:01:11.385788 2019] [:error] [pid 10872]     response = handler(environ)
[Wed Nov 06 16:01:11.385794 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:01:11.385800 2019] [:error] [pid 10872]     return self._dispatch(method, params)
[Wed Nov 06 16:01:11.385807 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:01:11.385820 2019] [:error] [pid 10872]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:01:11.385827 2019] [:error] [pid 10872]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:01:11.385833 2019] [:error] [pid 10872]     return func(*args, **kwargs)
[Wed Nov 06 16:01:11.385845 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:01:11.385868 2019] [:error] [pid 10872]     return query.execute()
[Wed Nov 06 16:01:11.385875 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 8664, in execute
[Wed Nov 06 16:01:11.385882 2019] [:error] [pid 10872]     data = _multiRow(query, self.values, (self.aliases or self.columns))
[Wed Nov 06 16:01:11.385888 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow
[Wed Nov 06 16:01:11.385894 2019] [:error] [pid 10872]     return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]
[Wed Nov 06 16:01:11.385900 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti
[Wed Nov 06 16:01:11.385906 2019] [:error] [pid 10872]     c.execute(query, values)
[Wed Nov 06 16:01:11.385912 2019] [:error] [pid 10872]   File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute
[Wed Nov 06 16:01:11.385948 2019] [:error] [pid 10872]     ret = self.cursor.execute(operation, parameters)
[Wed Nov 06 16:01:11.385969 2019] [:error] [pid 10872] ProgrammingError: function array_remove(character varying[], unknown) does not exist
[Wed Nov 06 16:01:11.385976 2019] [:error] [pid 10872] LINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...
[Wed Nov 06 16:01:11.385983 2019] [:error] [pid 10872]                    ^
[Wed Nov 06 16:01:11.385989 2019] [:error] [pid 10872] HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
[Wed Nov 06 16:01:11.385995 2019] [:error] [pid 10872]
[Wed Nov 06 16:01:11.386001 2019] [:error] [pid 10872]
[Wed Nov 06 16:01:11.386049 2019] [:error] [pid 10872] 385 [WARNING] m=None u=None p=10872 r=?:? koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:01:11.386070 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:01:11.386077 2019] [:error] [pid 10872]     response = handler(environ)
[Wed Nov 06 16:01:11.386084 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:01:11.386090 2019] [:error] [pid 10872]     return self._dispatch(method, params)
[Wed Nov 06 16:01:11.386096 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:01:11.386102 2019] [:error] [pid 10872]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:01:11.386109 2019] [:error] [pid 10872]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:01:11.386115 2019] [:error] [pid 10872]     return func(*args, **kwargs)
[Wed Nov 06 16:01:11.386122 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:01:11.386131 2019] [:error] [pid 10872]     return query.execute()
[Wed Nov 06 16:01:11.386141 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 8664, in execute
[Wed Nov 06 16:01:11.386151 2019] [:error] [pid 10872]     data = _multiRow(query, self.values, (self.aliases or self.columns))
[Wed Nov 06 16:01:11.386161 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow
[Wed Nov 06 16:01:11.386167 2019] [:error] [pid 10872]     return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]
[Wed Nov 06 16:01:11.386174 2019] [:error] [pid 10872]   File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti
[Wed Nov 06 16:01:11.386180 2019] [:error] [pid 10872]     c.execute(query, values)
[Wed Nov 06 16:01:11.386186 2019] [:error] [pid 10872]   File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute
[Wed Nov 06 16:01:11.386192 2019] [:error] [pid 10872]     ret = self.cursor.execute(operation, parameters)
[Wed Nov 06 16:01:11.386198 2019] [:error] [pid 10872] ProgrammingError: function array_remove(character varying[], unknown) does not exist
[Wed Nov 06 16:01:11.386204 2019] [:error] [pid 10872] LINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...
[Wed Nov 06 16:01:11.386226 2019] [:error] [pid 10872]                    ^
[Wed Nov 06 16:01:11.386239 2019] [:error] [pid 10872] HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
[Wed Nov 06 16:01:11.386246 2019] [:error] [pid 10872]
[Wed Nov 06 16:01:11.386252 2019] [:error] [pid 10872]
[Wed Nov 06 16:01:11.390744 2019] [:error] [pid 11888] 2019-11-06 16:01:11,390 [ERROR] m=None u=None p=11888 r=?:? koji.web: Traceback (most recent call last):
[Wed Nov 06 16:01:11.390789 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:01:11.390797 2019] [:error] [pid 11888]     result = func(environ, **data)
[Wed Nov 06 16:01:11.390803 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/index.py", line 1241, in builds
[Wed Nov 06 16:01:11.390810 2019] [:error] [pid 11888]     values['users'] = server.listUsers(queryOpts={'order': 'name'})
[Wed Nov 06 16:01:11.390831 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:01:11.390838 2019] [:error] [pid 11888]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:01:11.390844 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:01:11.390851 2019] [:error] [pid 11888]     raise err
[Wed Nov 06 16:01:11.390889 2019] [:error] [pid 11888] Fault: <Fault 1: 'Traceback (most recent call last):\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler\\n    response = handler(environ)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc\\n    return self._dispatch(method, params)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch\\n    ret = koji.util.call_with_argcheck(func, params, opts)\\n  File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck\\n    return func(*args, **kwargs)\\n  File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers\\n    return query.execute()\\n  File "/usr/share/koji-hub/kojihub.py", line 8664, in execute\\n    data = _multiRow(query, self.values, (self.aliases or self.columns))\\n  File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow\\n    return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]\\n  File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti\\n    c.execute(query, values)\\n  File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute\\n    ret = self.cursor.execute(operation, parameters)\\nProgrammingError: function array_remove(character varying[], unknown) does not exist\\nLINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...\\n                   ^\\nHINT:  No function matches the given name and argument types. You might need to add explicit type casts.\\n\\n'>
[Wed Nov 06 16:01:11.390900 2019] [:error] [pid 11888]
[Wed Nov 06 16:01:11.390978 2019] [:error] [pid 11888] 390 [ERROR] m=builds u=None p=11888 r=10.209.44.12:52272 koji.web: Traceback (most recent call last):
[Wed Nov 06 16:01:11.390995 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:01:11.391002 2019] [:error] [pid 11888]     result = func(environ, **data)
[Wed Nov 06 16:01:11.391009 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/index.py", line 1241, in builds
[Wed Nov 06 16:01:11.391015 2019] [:error] [pid 11888]     values['users'] = server.listUsers(queryOpts={'order': 'name'})
[Wed Nov 06 16:01:11.391026 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:01:11.391049 2019] [:error] [pid 11888]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:01:11.391056 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:01:11.391062 2019] [:error] [pid 11888]     raise err
[Wed Nov 06 16:01:11.391070 2019] [:error] [pid 11888] Fault: <Fault 1: 'Traceback (most recent call last):\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler\\n    response = handler(environ)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc\\n    return self._dispatch(method, params)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch\\n    ret = koji.util.call_with_argcheck(func, params, opts)\\n  File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck\\n    return func(*args, **kwargs)\\n  File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers\\n    return query.execute()\\n  File "/usr/share/koji-hub/kojihub.py", line 8664, in execute\\n    data = _multiRow(query, self.values, (self.aliases or self.columns))\\n  File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow\\n    return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]\\n  File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti\\n    c.execute(query, values)\\n  File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute\\n    ret = self.cursor.execute(operation, parameters)\\nProgrammingError: function array_remove(character varying[], unknown) does not exist\\nLINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...\\n                   ^\\nHINT:  No function matches the given name and argument types. You might need to add explicit type casts.\\n\\n'>
[Wed Nov 06 16:01:11.391091 2019] [:error] [pid 11888]

Clicking on the Tasks tab causes:

K[Wed Nov 06 16:02:39.394321 2019] [:error] [pid 10752] 2019-11-06 16:02:39,393 [ERROR] m=listUsers u=None p=10752 r=10.201.64.55:58930 koji.db: Query failed. Query was: 
[Wed Nov 06 16:02:39.394401 2019] [:error] [pid 10752] SELECT id, array_remove(array_agg(krb_principal), NULL), name, status, usertype
[Wed Nov 06 16:02:39.394410 2019] [:error] [pid 10752]   FROM users
[Wed Nov 06 16:02:39.394417 2019] [:error] [pid 10752]   LEFT JOIN user_krb_principals ON users.id = user_krb_principals.user_id
[Wed Nov 06 16:02:39.394424 2019] [:error] [pid 10752]  WHERE (usertype = 0)
[Wed Nov 06 16:02:39.394430 2019] [:error] [pid 10752]  GROUP BY users.id
[Wed Nov 06 16:02:39.394437 2019] [:error] [pid 10752]  ORDER BY name
[Wed Nov 06 16:02:39.394443 2019] [:error] [pid 10752] 
[Wed Nov 06 16:02:39.394452 2019] [:error] [pid 10752]  
[Wed Nov 06 16:02:39.394461 2019] [:error] [pid 10752] 
[Wed Nov 06 16:02:39.394623 2019] [:error] [pid 10752] 393 [ERROR] m=None u=None p=10752 r=?:? koji.db: Query failed. Query was: 
[Wed Nov 06 16:02:39.394646 2019] [:error] [pid 10752] SELECT id, array_remove(array_agg(krb_principal), NULL), name, status, usertype
[Wed Nov 06 16:02:39.394657 2019] [:error] [pid 10752]   FROM users
[Wed Nov 06 16:02:39.394667 2019] [:error] [pid 10752]   LEFT JOIN user_krb_principals ON users.id = user_krb_principals.user_id
[Wed Nov 06 16:02:39.394678 2019] [:error] [pid 10752]  WHERE (usertype = 0)
[Wed Nov 06 16:02:39.394688 2019] [:error] [pid 10752]  GROUP BY users.id
[Wed Nov 06 16:02:39.394785 2019] [:error] [pid 10752]  ORDER BY name
[Wed Nov 06 16:02:39.394795 2019] [:error] [pid 10752] 
[Wed Nov 06 16:02:39.394801 2019] [:error] [pid 10752]  
[Wed Nov 06 16:02:39.394807 2019] [:error] [pid 10752] 
[Wed Nov 06 16:02:39.395987 2019] [:error] [pid 10752] 2019-11-06 16:02:39,395 [WARNING] m=listUsers u=None p=10752 r=10.201.64.55:58930 koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:02:39.396021 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:02:39.396029 2019] [:error] [pid 10752]     response = handler(environ)
[Wed Nov 06 16:02:39.396036 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:02:39.396042 2019] [:error] [pid 10752]     return self._dispatch(method, params)
[Wed Nov 06 16:02:39.396049 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:02:39.396055 2019] [:error] [pid 10752]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:02:39.396064 2019] [:error] [pid 10752]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:02:39.396071 2019] [:error] [pid 10752]     return func(*args, **kwargs)
[Wed Nov 06 16:02:39.396095 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:02:39.396133 2019] [:error] [pid 10752]     return query.execute()
[Wed Nov 06 16:02:39.396141 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 8664, in execute
[Wed Nov 06 16:02:39.396147 2019] [:error] [pid 10752]     data = _multiRow(query, self.values, (self.aliases or self.columns))
[Wed Nov 06 16:02:39.396154 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow
[Wed Nov 06 16:02:39.396160 2019] [:error] [pid 10752]     return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]
[Wed Nov 06 16:02:39.396190 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti
[Wed Nov 06 16:02:39.396294 2019] [:error] [pid 10752]     c.execute(query, values)
[Wed Nov 06 16:02:39.396404 2019] [:error] [pid 10752]   File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute
[Wed Nov 06 16:02:39.396412 2019] [:error] [pid 10752]     ret = self.cursor.execute(operation, parameters)
[Wed Nov 06 16:02:39.396426 2019] [:error] [pid 10752] ProgrammingError: function array_remove(character varying[], unknown) does not exist
[Wed Nov 06 16:02:39.396518 2019] [:error] [pid 10752] LINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...
[Wed Nov 06 16:02:39.396526 2019] [:error] [pid 10752]                    ^
[Wed Nov 06 16:02:39.396548 2019] [:error] [pid 10752] HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
[Wed Nov 06 16:02:39.396577 2019] [:error] [pid 10752]
[Wed Nov 06 16:02:39.396666 2019] [:error] [pid 10752]
[Wed Nov 06 16:02:39.396753 2019] [:error] [pid 10752] 395 [WARNING] m=None u=None p=10752 r=?:? koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:02:39.396793 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:02:39.396802 2019] [:error] [pid 10752]     response = handler(environ)
[Wed Nov 06 16:02:39.396809 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:02:39.396816 2019] [:error] [pid 10752]     return self._dispatch(method, params)
[Wed Nov 06 16:02:39.396822 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:02:39.396829 2019] [:error] [pid 10752]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:02:39.396835 2019] [:error] [pid 10752]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:02:39.396842 2019] [:error] [pid 10752]     return func(*args, **kwargs)
[Wed Nov 06 16:02:39.396848 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:02:39.396855 2019] [:error] [pid 10752]     return query.execute()
[Wed Nov 06 16:02:39.396861 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 8664, in execute
[Wed Nov 06 16:02:39.396868 2019] [:error] [pid 10752]     data = _multiRow(query, self.values, (self.aliases or self.columns))
[Wed Nov 06 16:02:39.396874 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow
[Wed Nov 06 16:02:39.396881 2019] [:error] [pid 10752]     return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]
[Wed Nov 06 16:02:39.396893 2019] [:error] [pid 10752]   File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti
[Wed Nov 06 16:02:39.396914 2019] [:error] [pid 10752]     c.execute(query, values)
[Wed Nov 06 16:02:39.396940 2019] [:error] [pid 10752]   File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute
[Wed Nov 06 16:02:39.396955 2019] [:error] [pid 10752]     ret = self.cursor.execute(operation, parameters)
[Wed Nov 06 16:02:39.396962 2019] [:error] [pid 10752] ProgrammingError: function array_remove(character varying[], unknown) does not exist
[Wed Nov 06 16:02:39.396968 2019] [:error] [pid 10752] LINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...
[Wed Nov 06 16:02:39.396975 2019] [:error] [pid 10752]                    ^
[Wed Nov 06 16:02:39.396981 2019] [:error] [pid 10752] HINT:  No function matches the given name and argument types. You might need to add explicit type casts.
[Wed Nov 06 16:02:39.396988 2019] [:error] [pid 10752]
[Wed Nov 06 16:02:39.396994 2019] [:error] [pid 10752]
[Wed Nov 06 16:02:39.400984 2019] [:error] [pid 11888] 2019-11-06 16:02:39,400 [ERROR] m=None u=None p=11888 r=?:? koji.web: Traceback (most recent call last):
[Wed Nov 06 16:02:39.401064 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:02:39.401074 2019] [:error] [pid 11888]     result = func(environ, **data)
[Wed Nov 06 16:02:39.401081 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/index.py", line 482, in tasks
[Wed Nov 06 16:02:39.401087 2019] [:error] [pid 11888]     values['users'] = server.listUsers(queryOpts={'order': 'name'})
[Wed Nov 06 16:02:39.401095 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:02:39.401127 2019] [:error] [pid 11888]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:02:39.401151 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:02:39.401327 2019] [:error] [pid 11888]     raise err
[Wed Nov 06 16:02:39.401349 2019] [:error] [pid 11888] Fault: <Fault 1: 'Traceback (most recent call last):\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler\\n    response = handler(environ)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc\\n    return self._dispatch(method, params)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch\\n    ret = koji.util.call_with_argcheck(func, params, opts)\\n  File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck\\n    return func(*args, **kwargs)\\n  File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers\\n    return query.execute()\\n  File "/usr/share/koji-hub/kojihub.py", line 8664, in execute\\n    data = _multiRow(query, self.values, (self.aliases or self.columns))\\n  File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow\\n    return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]\\n  File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti\\n    c.execute(query, values)\\n  File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute\\n    ret = self.cursor.execute(operation, parameters)\\nProgrammingError: function array_remove(character varying[], unknown) does not exist\\nLINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...\\n                   ^\\nHINT:  No function matches the given name and argument types. You might need to add explicit type casts.\\n\\n'>
[Wed Nov 06 16:02:39.401367 2019] [:error] [pid 11888]
[Wed Nov 06 16:02:39.401473 2019] [:error] [pid 11888] 400 [ERROR] m=tasks u=None p=11888 r=10.209.44.12:52302 koji.web: Traceback (most recent call last):
[Wed Nov 06 16:02:39.401497 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:02:39.401504 2019] [:error] [pid 11888]     result = func(environ, **data)
[Wed Nov 06 16:02:39.401510 2019] [:error] [pid 11888]   File "/usr/share/koji-web/scripts/index.py", line 482, in tasks
[Wed Nov 06 16:02:39.401517 2019] [:error] [pid 11888]     values['users'] = server.listUsers(queryOpts={'order': 'name'})
[Wed Nov 06 16:02:39.401523 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:02:39.401548 2019] [:error] [pid 11888]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:02:39.401566 2019] [:error] [pid 11888]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:02:39.401579 2019] [:error] [pid 11888]     raise err
[Wed Nov 06 16:02:39.401640 2019] [:error] [pid 11888] Fault: <Fault 1: 'Traceback (most recent call last):\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler\\n    response = handler(environ)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc\\n    return self._dispatch(method, params)\\n  File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch\\n    ret = koji.util.call_with_argcheck(func, params, opts)\\n  File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck\\n    return func(*args, **kwargs)\\n  File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers\\n    return query.execute()\\n  File "/usr/share/koji-hub/kojihub.py", line 8664, in execute\\n    data = _multiRow(query, self.values, (self.aliases or self.columns))\\n  File "/usr/share/koji-hub/kojihub.py", line 4903, in _multiRow\\n    return [dict(zip(fields, row)) for row in _fetchMulti(query, values)]\\n  File "/usr/share/koji-hub/kojihub.py", line 4875, in _fetchMulti\\n    c.execute(query, values)\\n  File "/usr/lib/python2.7/site-packages/koji/db.py", line 136, in execute\\n    ret = self.cursor.execute(operation, parameters)\\nProgrammingError: function array_remove(character varying[], unknown) does not exist\\nLINE 2: SELECT id, array_remove(array_agg(krb_principal), NULL), nam...\\n                   ^\\nHINT:  No function matches the given name and argument types. You might need to add explicit type casts.\\n\\n'>
[Wed Nov 06 16:02:39.401728 2019] [:error] [pid 11888]

Users tab causes:

[Wed Nov 06 16:04:23.313610 2019] [:error] [pid 10209] 2019-11-06 16:04:23,313 [WARNING] m=listUsers u=None p=10209 r=10.201.64.55:58972 koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:04:23.313696 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:04:23.313706 2019] [:error] [pid 10209]     response = handler(environ)
[Wed Nov 06 16:04:23.313713 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:04:23.313720 2019] [:error] [pid 10209]     return self._dispatch(method, params)
[Wed Nov 06 16:04:23.313726 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:04:23.313732 2019] [:error] [pid 10209]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:04:23.313739 2019] [:error] [pid 10209]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:04:23.313745 2019] [:error] [pid 10209]     return func(*args, **kwargs)
[Wed Nov 06 16:04:23.313752 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:04:23.313758 2019] [:error] [pid 10209]     return query.execute()
[Wed Nov 06 16:04:23.313765 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 8652, in execute
[Wed Nov 06 16:04:23.313771 2019] [:error] [pid 10209]     return _singleValue(query, self.values, strict=True)
[Wed Nov 06 16:04:23.313777 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 4927, in _singleValue
[Wed Nov 06 16:04:23.313784 2019] [:error] [pid 10209]     row = _fetchSingle(query, values, strict)
[Wed Nov 06 16:04:23.313790 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 4893, in _fetchSingle
[Wed Nov 06 16:04:23.313796 2019] [:error] [pid 10209]     raise koji.GenericError('multiple rows returned for a single row query')
[Wed Nov 06 16:04:23.313803 2019] [:error] [pid 10209] GenericError: multiple rows returned for a single row query
[Wed Nov 06 16:04:23.313809 2019] [:error] [pid 10209]
[Wed Nov 06 16:04:23.313916 2019] [:error] [pid 10209] 313 [WARNING] m=None u=None p=10209 r=?:? koji.xmlrpc: Traceback (most recent call last):
[Wed Nov 06 16:04:23.313928 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 235, in _wrap_handler
[Wed Nov 06 16:04:23.313934 2019] [:error] [pid 10209]     response = handler(environ)
[Wed Nov 06 16:04:23.313941 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 278, in handle_rpc
[Wed Nov 06 16:04:23.313947 2019] [:error] [pid 10209]     return self._dispatch(method, params)
[Wed Nov 06 16:04:23.313953 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojixmlrpc.py", line 315, in _dispatch
[Wed Nov 06 16:04:23.313960 2019] [:error] [pid 10209]     ret = koji.util.call_with_argcheck(func, params, opts)
[Wed Nov 06 16:04:23.313966 2019] [:error] [pid 10209]   File "/usr/lib/python2.7/site-packages/koji/util.py", line 261, in call_with_argcheck
[Wed Nov 06 16:04:23.313980 2019] [:error] [pid 10209]     return func(*args, **kwargs)
[Wed Nov 06 16:04:23.313986 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 11245, in listUsers
[Wed Nov 06 16:04:23.313993 2019] [:error] [pid 10209]     return query.execute()
[Wed Nov 06 16:04:23.313999 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 8652, in execute
[Wed Nov 06 16:04:23.314005 2019] [:error] [pid 10209]     return _singleValue(query, self.values, strict=True)
[Wed Nov 06 16:04:23.314011 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 4927, in _singleValue
[Wed Nov 06 16:04:23.314017 2019] [:error] [pid 10209]     row = _fetchSingle(query, values, strict)
[Wed Nov 06 16:04:23.314024 2019] [:error] [pid 10209]   File "/usr/share/koji-hub/kojihub.py", line 4893, in _fetchSingle
[Wed Nov 06 16:04:23.314030 2019] [:error] [pid 10209]     raise koji.GenericError('multiple rows returned for a single row query')
[Wed Nov 06 16:04:23.314036 2019] [:error] [pid 10209] GenericError: multiple rows returned for a single row query
[Wed Nov 06 16:04:23.314042 2019] [:error] [pid 10209]
[Wed Nov 06 16:04:23.323626 2019] [:error] [pid 11894] 2019-11-06 16:04:23,323 [ERROR] m=None u=None p=11894 r=?:? koji.web: Traceback (most recent call last):
[Wed Nov 06 16:04:23.323684 2019] [:error] [pid 11894]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:04:23.323693 2019] [:error] [pid 11894]     result = func(environ, **data)
[Wed Nov 06 16:04:23.323700 2019] [:error] [pid 11894]   File "/usr/share/koji-web/scripts/index.py", line 1322, in users
[Wed Nov 06 16:04:23.323706 2019] [:error] [pid 11894]     start=start, dataName='users', prefix='user', order=order)
[Wed Nov 06 16:04:23.323712 2019] [:error] [pid 11894]   File "/usr/share/koji-web/lib/kojiweb/util.py", line 316, in paginateMethod
[Wed Nov 06 16:04:23.323718 2019] [:error] [pid 11894]     totalRows = getattr(server, methodName)(*args, **kw)
[Wed Nov 06 16:04:23.323724 2019] [:error] [pid 11894]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:04:23.323731 2019] [:error] [pid 11894]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:04:23.323737 2019] [:error] [pid 11894]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:04:23.323743 2019] [:error] [pid 11894]     raise err
[Wed Nov 06 16:04:23.323750 2019] [:error] [pid 11894] GenericError: multiple rows returned for a single row query
[Wed Nov 06 16:04:23.323756 2019] [:error] [pid 11894]
[Wed Nov 06 16:04:23.323842 2019] [:error] [pid 11894] 323 [ERROR] m=users u=None p=11894 r=10.209.44.12:52322 koji.web: Traceback (most recent call last):
[Wed Nov 06 16:04:23.323859 2019] [:error] [pid 11894]   File "/usr/share/koji-web/scripts/wsgi_publisher.py", line 372, in handle_request
[Wed Nov 06 16:04:23.323866 2019] [:error] [pid 11894]     result = func(environ, **data)
[Wed Nov 06 16:04:23.323873 2019] [:error] [pid 11894]   File "/usr/share/koji-web/scripts/index.py", line 1322, in users
[Wed Nov 06 16:04:23.323879 2019] [:error] [pid 11894]     start=start, dataName='users', prefix='user', order=order)
[Wed Nov 06 16:04:23.323890 2019] [:error] [pid 11894]   File "/usr/share/koji-web/lib/kojiweb/util.py", line 316, in paginateMethod
[Wed Nov 06 16:04:23.323904 2019] [:error] [pid 11894]     totalRows = getattr(server, methodName)(*args, **kw)
[Wed Nov 06 16:04:23.323911 2019] [:error] [pid 11894]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2135, in __call__
[Wed Nov 06 16:04:23.323918 2019] [:error] [pid 11894]     return self.__func(self.__name, args, opts)
[Wed Nov 06 16:04:23.323938 2019] [:error] [pid 11894]   File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2650, in _callMethod
[Wed Nov 06 16:04:23.323952 2019] [:error] [pid 11894]     raise err
[Wed Nov 06 16:04:23.323959 2019] [:error] [pid 11894] GenericError: multiple rows returned for a single row query
[Wed Nov 06 16:04:23.323978 2019] [:error] [pid 11894]

The other tabs seem to function fine. I applied the schema-upgrade as usual. Is there something else I need to do?

I should have mentioned this is with the following from EPEL testing:
koji-1.19.0-1.el7.noarch
koji-hub-1.19.0-1.el7.noarch
koji-hub-plugins-1.19.0-1.el7.noarch
koji-utils-1.19.0-1.el7.noarch
koji-web-1.19.0-1.el7.noarch
python2-koji-1.19.0-1.el7.noarch
python2-koji-hub-1.19.0-1.el7.noarch
python2-koji-hub-plugins-1.19.0-1.el7.noarch
python2-koji-web-1.19.0-1.el7.noarch
Edited by jflorian

@jflorian
PR #1751 should fix this issue. Could you please have a try?

Metadata Update from @julian8628:
- Custom field Size adjusted to None

Metadata Update from @tkopecek:
- Issue close_status updated to: Duplicate
- Issue status updated to: Closed (was: Open)

Duplicate of #1750

@jflorian
PR #1751 should fix this issue. Could you please have a try?

Indeed this does. Definitely a dupe though I tried hard to find one first. Thanks for the pointer.

This issue has been migrated to Fedora Forge:
https://forge.fedoraproject.org/koji/koji/issues/1770

Please continue any further discussion there.
Metadata
None
None
None
None
Low
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.