[03:17:20.252] src/tools/ci/cores_backtrace.sh linux /tmp/cores [03:17:20.981] dumping /tmp/cores/postgres-3-19328.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [03:17:22.708] [New LWP 19328] [03:17:22.708] [New LWP 18352] [03:17:22.708] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [03:17:23.501] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [03:17:24.297] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [03:17:25.569] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [03:17:28.033] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [03:17:28.033] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [03:17:29.977] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [03:17:31.238] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [03:17:32.876] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [03:17:33.978] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [03:17:34.772] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [03:17:36.049] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [03:17:37.731] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [03:17:39.198] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [03:17:40.147] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [03:17:41.743] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [03:17:43.188] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [03:17:43.684] [Thread debugging using libthread_db enabled] [03:17:43.684] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [03:17:44.791] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [03:17:46.236] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [03:17:47.345] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [03:17:47.987] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [03:17:48.783] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [03:17:51.155] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [03:17:52.116] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [03:17:52.914] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [03:17:53.862] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [03:17:54.812] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [03:17:56.466] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [03:17:57.570] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [03:17:58.367] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [03:17:59.808] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [03:18:00.449] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [03:18:02.042] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [03:18:02.836] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [03:18:04.110] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [03:18:04.909] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [03:18:06.021] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [03:18:06.981] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [03:18:08.255] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [03:18:08.897] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [03:18:09.853] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [03:18:10.648] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [03:18:11.171] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [03:18:11.171] Program terminated with signal SIGQUIT, Quit. [03:18:11.171] #0 0x00007efc4af09fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.200] [Current thread is 1 (LWP 19328)] [03:18:11.346] [03:18:11.346] Thread 2 (Thread 0x7efc488a0a40 (LWP 18352)): [03:18:11.346] #0 0x00007efc4afcca61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.346] No symbol table info available. [03:18:11.346] #1 0x00007efc4afbae5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.346] No symbol table info available. [03:18:11.346] #2 0x00007efc4afbb497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.346] No symbol table info available. [03:18:11.346] #3 0x00007efc4afbacdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.346] No symbol table info available. [03:18:11.346] #4 0x00007efc4af16a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.346] No symbol table info available. [03:18:11.346] #5 0x00005639f7317950 in RestoreArchivedFile (path=path@entry=0x7ffdcdd88f60 "", xlogfname=xlogfname@entry=0x7ffdcdd893b0 "00000001", '0' , "5", recovername=recovername@entry=0x5639f7de60dc "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:178 [03:18:11.346] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "pg_wal/000000015", '0' , '\000' , "\b\000\000\000\000\000\000\000\304(\336\367\071V\000\000\210\216\330\315\375\177\000\000\270(\336\367\071V\000\000.\340\304\367\071V\000\000\260\223\330\315\375\177\000\000\227`\336\367\071V\000\000\210\216\330\315\375\177\000\000\225`\336\367\071V\000\000\030\t\212H\374~\000\000\212\352\304\367\071V", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [03:18:11.346] xlogRestoreCmd = 0x5639fa199818 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000001", '0' , "5\" \"pg_wal/RECOVERYXLOG\"" [03:18:11.346] lastRestartPointFname = "00000001", '0' , "2\000\352\304\367\071V", '\000' , "\001\000\000FK\000\000\300\026\nK\374~\000\000`\027\nK\374~\000\000FK\000\000\002", '\000' , "\020m\361J\374~\000\000P\207\330\315\375\177", '\000' , "Wa\006K\374~\000\000Oa\006K\374~\000\000\030\230\031\372\071V", '\000' , "@", '\000' ... [03:18:11.346] rc = [03:18:11.346] stat_buf = {st_dev = 94806969987602, st_ino = 335544320, st_nlink = 139622054141280, st_mode = 0, st_uid = 0, st_gid = 1003, __pad0 = 0, st_rdev = 11782978481571891200, st_size = 16777216, st_blksize = 94807009105944, st_blocks = 140728056973648, st_atim = {tv_sec = 140728056973232, tv_nsec = 140728056973360}, st_mtim = {tv_sec = 0, tv_nsec = 94807009105944}, st_ctim = {tv_sec = 139622054868119, tv_nsec = 0}, __glibc_reserved = {94806969999406, 140728056976320, 94806971656209}} [03:18:11.346] restartSegNo = [03:18:11.346] restartRedoPtr = 33563712 [03:18:11.346] restartTli = 1 [03:18:11.346] __func__ = "RestoreArchivedFile" [03:18:11.346] #6 0x00005639f73265e0 in XLogFileRead (segno=140728056976224, segno@entry=5, emode=emode@entry=13, tli=tli@entry=1, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4206 [03:18:11.346] xlogfname = "00000001", '0' , "5\000history\000\000\000\000\000\000\000\000(e\024\372\071V\000\000\a\000\000\000\002\000\000\000\004\000\000\t\000\000\000" [03:18:11.346] activitymsg = "waiting for 00000001", '0' , "5\000\177\000\000.\340\304\367\071V\000\000PM\351\367\071V\000\000MM\351\367\071V\000\000Ȗ\330\315\375\177\000\000KM\351\367\071V\000" [03:18:11.346] path = "\000\223\330\315\375\177\000\000\000\223\330\315\000\000\000\000\001\000\000\000\000\000\000\000\352\336\304\367\071V\000\000pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\002\345\304\367\071V\000\062", '\000' , "\b\000\000\000\000\000\000\000I\320\335\367\071V\000\000\350\222\330\315\375\177\000\000E\320\335\367\071V\000\000.\340\304\367\071V\000\000Q\320\335\367\071V\000\000I\320\335\367\071V\000\000\350\222\330\315\375\177\000\000E\320\335\367\071V\000\000\030\t\212H\374~\000\000\314\351\304\367\071V", '\000' ... [03:18:11.346] fd = [03:18:11.346] __func__ = "XLogFileRead" [03:18:11.346] #7 0x00005639f73267d0 in XLogFileReadAnyTLI (segno=5, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4334 [03:18:11.346] hent = [03:18:11.346] tli = 1 [03:18:11.346] cell__state = {l = , i = } [03:18:11.346] path = "7P\336\367\071V\000\000\030\t\212H\374~\000\000\360\226\330\315\375\177\000\000n\362\304\367\071V\000\000\000\000\000\000\000\000\000\000\342\333x\370\071V\000\000`\334x\370\071V\000\000\264\225\330\315\375\177\000\000xL\351\367\071V\000\000\361\333x\370\071V\000\000`\334x\370\071V\000\000ԕ\330\315\375\177\000\000\207L\351\367\071V\000\000`\334x\370\071V\000\000\002\000\000\000\000\000\000\000+\372\304\367\071V\000\000֕\330\315\375\177\000\000ԕ\330\315\375\177", '\000' , "SSA\030\000\000\000\060\000\000\000\260\225\330\315\375\177\000\000\004\373\304\367\071V\000\000\b\212\330\315\375\177\000\000\030\000\000\000"... [03:18:11.346] cell = [03:18:11.346] fd = [03:18:11.346] tles = 0x5639fa1abfc8 [03:18:11.346] __func__ = "XLogFileReadAnyTLI" [03:18:11.346] #8 0x00005639f73279cc in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3767 [03:18:11.346] oldSource = [03:18:11.346] startWalReceiver = false [03:18:11.346] last_fail_time = 761973263070416 [03:18:11.346] now = [03:18:11.346] streaming_reply_sent = false [03:18:11.346] __func__ = "WaitForWALToBecomeAvailable" [03:18:11.346] #9 0x00005639f7328501 in XLogPageRead (xlogreader=0x5639fa146e50, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x5639fa195fe8 "\024\321\002") at ../src/backend/access/transam/xlogrecovery.c:3348 [03:18:11.346] private = 0x5639fa146e30 [03:18:11.346] emode = 15 [03:18:11.346] targetPageOff = 0 [03:18:11.346] targetSegNo = 5 [03:18:11.346] r = [03:18:11.346] __func__ = "XLogPageRead" [03:18:11.346] #10 0x00005639f7330926 in ReadPageInternal (state=state@entry=0x5639fa146e50, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1062 [03:18:11.346] readLen = [03:18:11.346] targetPageOff = 0 [03:18:11.346] targetSegNo = 5 [03:18:11.346] hdr = [03:18:11.346] #11 0x00005639f7332581 in XLogDecodeNextRecord (state=state@entry=0x5639fa146e50, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:599 [03:18:11.346] RecPtr = 83886080 [03:18:11.346] record = [03:18:11.346] targetPagePtr = 83886080 [03:18:11.346] randAccess = false [03:18:11.346] len = [03:18:11.346] total_len = [03:18:11.346] targetRecOff = 0 [03:18:11.346] pageHeaderSize = [03:18:11.346] assembled = false [03:18:11.346] gotheader = [03:18:11.346] readOff = [03:18:11.346] decoded = 0x0 [03:18:11.346] errormsg = 0x5639f7302d92 "\204\300\017\205q\001" [03:18:11.346] #12 0x00005639f7333123 in XLogReadAhead (state=0x5639fa146e50, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:975 [03:18:11.346] result = [03:18:11.346] #13 0x00005639f731da9b in XLogPrefetcherNextBlock (pgsr_private=94807008771200, lsn=0x5639fa1ab998) at ../src/backend/access/transam/xlogprefetcher.c:496 [03:18:11.346] nonblocking = [03:18:11.346] record = [03:18:11.346] prefetcher = 0x5639fa147c80 [03:18:11.346] reader = 0x5639fa146e50 [03:18:11.346] replaying_lsn = 67109152 [03:18:11.346] __func__ = "XLogPrefetcherNextBlock" [03:18:11.346] #14 0x00005639f7321e64 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:256 [03:18:11.346] No locals. [03:18:11.346] #15 lrq_complete_lsn (lsn=83886080, lrq=0x5639fa1ab898) at ../src/backend/access/transam/xlogprefetcher.c:294 [03:18:11.346] No locals. [03:18:11.346] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5639fa147c80, errmsg=errmsg@entry=0x7ffdcdd8db48) at ../src/backend/access/transam/xlogprefetcher.c:1041 [03:18:11.346] record = [03:18:11.346] replayed_up_to = 83886080 [03:18:11.346] #17 0x00005639f7328d2e in ReadRecord (xlogprefetcher=0x5639fa147c80, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3148 [03:18:11.346] errormsg = 0x5639f7812cdd "AUATUSH\203\354\bH\205\377\017\204:\001" [03:18:11.368] record = [03:18:11.368] xlogreader = 0x5639fa146e50 [03:18:11.368] private = [03:18:11.368] __func__ = "ReadRecord" [03:18:11.368] #18 0x00005639f732be8f in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1829 [03:18:11.368] xtime = [03:18:11.368] ru0 = {tv = {tv_sec = 1708658059, tv_usec = 526414}, ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 1241}, {ru_maxrss = 15788, __ru_maxrss_word = 15788}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 398, __ru_minflt_word = 398}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [03:18:11.368] record = 0x7efc481e41f0 [03:18:11.368] reachedRecoveryTarget = false [03:18:11.368] replayTLI = 1 [03:18:11.368] __func__ = "PerformWalRecovery" [03:18:11.368] #19 0x00005639f7315bd9 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5733 [03:18:11.368] Insert = [03:18:11.368] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1708658058, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [03:18:11.368] wasShutdown = false [03:18:11.368] didCrash = [03:18:11.368] haveTblspcMap = false [03:18:11.368] haveBackupLabel = false [03:18:11.368] EndOfLog = [03:18:11.368] EndOfLogTLI = [03:18:11.368] newTLI = [03:18:11.368] performedWalRecovery = [03:18:11.368] endOfRecoveryInfo = [03:18:11.368] abortedRecPtr = [03:18:11.368] missingContrecPtr = [03:18:11.368] oldestActiveXID = [03:18:11.368] promoted = false [03:18:11.368] __func__ = "StartupXLOG" [03:18:11.368] #20 0x00005639f77c60d0 in StartupProcessMain () at ../src/backend/postmaster/startup.c:254 [03:18:11.368] No locals. [03:18:11.368] #21 0x00005639f77b6449 in AuxiliaryProcessMain (auxtype=auxtype@entry=StartupProcess) at ../src/backend/postmaster/auxprocess.c:142 [03:18:11.368] __func__ = "AuxiliaryProcessMain" [03:18:11.368] #22 0x00005639f77c1368 in StartChildProcess (type=type@entry=StartupProcess) at ../src/backend/postmaster/postmaster.c:5356 [03:18:11.368] pid = [03:18:11.368] __func__ = "StartChildProcess" [03:18:11.368] #23 0x00005639f77c5810 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5639fa145d20) at ../src/backend/postmaster/postmaster.c:1462 [03:18:11.368] opt = [03:18:11.368] status = [03:18:11.368] userDoption = [03:18:11.368] listen_addr_saved = false [03:18:11.368] output_config_variable = [03:18:11.368] __func__ = "PostmasterMain" [03:18:11.368] #24 0x00005639f75f032e in main (argc=4, argv=0x5639fa145d20) at ../src/backend/main/main.c:198 [03:18:11.368] do_check_root = [03:18:11.368] [03:18:11.368] Thread 1 (LWP 19328): [03:18:11.368] #0 0x00007efc4af09fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.368] No symbol table info available. [03:18:11.368] #1 0x00007efc4afbb13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.368] No symbol table info available. [03:18:11.368] #2 0x00007efc4afcca6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [03:18:11.368] No symbol table info available.