[14:12:12.078] src/tools/ci/cores_backtrace.sh linux /tmp/cores [14:12:12.780] dumping /tmp/cores/postgres-3-26367.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [14:12:14.464] [New LWP 26367] [14:12:14.464] [New LWP 25317] [14:12:14.464] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [14:12:15.226] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [14:12:15.991] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [14:12:17.212] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [14:12:19.577] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [14:12:19.577] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [14:12:21.449] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [14:12:22.659] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [14:12:24.229] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [14:12:25.285] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [14:12:26.044] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [14:12:27.268] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [14:12:28.870] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [14:12:30.273] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [14:12:31.181] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [14:12:32.715] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [14:12:34.103] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [14:12:34.575] [Thread debugging using libthread_db enabled] [14:12:34.575] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [14:12:35.643] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [14:12:37.033] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [14:12:38.093] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [14:12:38.706] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [14:12:39.468] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [14:12:41.743] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [14:12:42.651] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [14:12:43.415] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [14:12:44.339] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [14:12:45.253] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [14:12:46.835] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [14:12:47.898] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [14:12:48.662] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [14:12:50.046] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [14:12:50.661] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [14:12:52.192] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [14:12:52.955] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [14:12:54.177] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [14:12:54.941] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [14:12:56.011] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [14:12:56.929] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [14:12:58.153] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [14:12:58.766] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [14:12:59.689] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [14:13:00.449] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [14:13:00.948] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [14:13:00.948] Program terminated with signal SIGQUIT, Quit. [14:13:00.948] #0 0x00007fc380a30fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:00.977] [Current thread is 1 (LWP 26367)] [14:13:01.126] [14:13:01.126] Thread 2 (Thread 0x7fc37e3c7a40 (LWP 25317)): [14:13:01.126] #0 0x00007fc380af3a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.126] No symbol table info available. [14:13:01.126] #1 0x00007fc380ae1e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.126] No symbol table info available. [14:13:01.126] #2 0x00007fc380ae2497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.126] No symbol table info available. [14:13:01.126] #3 0x00007fc380ae1cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.126] No symbol table info available. [14:13:01.126] #4 0x00007fc380a3da69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.126] No symbol table info available. [14:13:01.126] #5 0x00005648a8887b32 in RestoreArchivedFile (path=path@entry=0x7ffd630fa210 "\001", xlogfname=xlogfname@entry=0x7ffd630fa1d0 "00000002.history", recovername=recovername@entry=0x5648a935d5d0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [14:13:01.126] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "Q9\034\251HV\000\062", '\000' , "\b\000\000\000\000\000\000\000\031C5\251HV\000\000\370\240\017c\375\177\000\000\025C5\251HV\000\000}4\034\251HV\000\000!C5\251HV\000\000\031C5\251HV\000\000\370\240\017c\375\177\000\000\025C5\251HV\000\000\030y<~\303\177\000\000\033>\034\251HV", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [14:13:01.126] xlogRestoreCmd = 0x5648ab6c6588 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [14:13:01.126] lastRestartPointFname = '0' , "\000F\034\251HV", '\000' , "P\234\017c\375\177\000\000\033>\034\251HV", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [14:13:01.126] rc = [14:13:01.126] stat_buf = {st_dev = 32768, st_ino = 207868941963, st_nlink = 744643031, st_mode = 1710511755, st_uid = 0, st_gid = 628643091, __pad0 = 0, st_rdev = 1710511755, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3832897741394030640, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 94870076497308, 140726265420952}} [14:13:01.126] restartSegNo = [14:13:01.126] restartRedoPtr = 94870074833233 [14:13:01.126] restartTli = 0 [14:13:01.126] __func__ = "RestoreArchivedFile" [14:13:01.126] #6 0x00005648a885df40 in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [14:13:01.126] path = "\001", '\000' , "\001\000\000\000\000\000\000\000\064l\211\250HV\000\000\374\304\065\251HV\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "5\000\000\000\000\000\000\000\000\000\342FѩHV\000\000`GѩHV\000\000ģ\017c\375\177\000\000\330\001A\251HV\000\000\361FѩHV\000\000`GѩHV\000\000\344\243\017c\375\177\000\000\347\001A\251HV\000\000`GѩHV\000\000\002\000\000\000\000\000\000\000zN\034\251HV\000\000\346\243\017c\375\177\000\000\344\243\017c\375\177", '\000' ... [14:13:01.126] histfname = "00000002.history\000\000\000\t\000\000\000\000\200柀\303\177\000\000\200\245\017c\002\000\000\000\212\066\070\202\303\000\000\000\070\215m\253HV\000\000\001\000\000\000\000\000\000" [14:13:01.126] fd = [14:13:01.126] __func__ = "existsTimeLineHistory" [14:13:01.126] #7 0x00005648a885e02b in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [14:13:01.126] newestTLI = 1 [14:13:01.126] probeTLI = 2 [14:13:01.126] #8 0x00005648a8892afd in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=83886080) at ../src/backend/access/transam/xlogrecovery.c:4113 [14:13:01.126] newExpectedTLEs = [14:13:01.126] found = [14:13:01.126] cell = [14:13:01.126] newtarget = [14:13:01.126] oldtarget = 1 [14:13:01.126] currentTle = 0x0 [14:13:01.126] __func__ = "rescanLatestTimeLine" [14:13:01.126] #9 0x00005648a8897cad in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [14:13:01.126] oldSource = XLOG_FROM_STREAM [14:13:01.126] startWalReceiver = false [14:13:01.126] last_fail_time = 763826959289287 [14:13:01.126] now = [14:13:01.126] streaming_reply_sent = false [14:13:01.126] __func__ = "WaitForWALToBecomeAvailable" [14:13:01.126] #10 0x00005648a88986e3 in XLogPageRead (xlogreader=0x5648ab673f00, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x5648ab6c2d58 "\024\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [14:13:01.126] private = 0x5648ab673ee0 [14:13:01.126] emode = 15 [14:13:01.126] targetPageOff = 0 [14:13:01.126] targetSegNo = 5 [14:13:01.126] r = [14:13:01.126] __func__ = "XLogPageRead" [14:13:01.126] #11 0x00005648a88a0b3e in ReadPageInternal (state=state@entry=0x5648ab673f00, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [14:13:01.126] readLen = [14:13:01.126] targetPageOff = 0 [14:13:01.126] targetSegNo = 5 [14:13:01.126] hdr = [14:13:01.126] #12 0x00005648a88a2799 in XLogDecodeNextRecord (state=state@entry=0x5648ab673f00, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [14:13:01.126] RecPtr = 83886080 [14:13:01.126] record = [14:13:01.126] targetPagePtr = 83886080 [14:13:01.126] randAccess = false [14:13:01.126] len = [14:13:01.126] total_len = [14:13:01.126] targetRecOff = 0 [14:13:01.126] pageHeaderSize = [14:13:01.126] assembled = false [14:13:01.126] gotheader = [14:13:01.126] readOff = [14:13:01.126] decoded = 0x0 [14:13:01.126] errormsg = 0x5648ab673f00 "~\204\211\250HV" [14:13:01.126] #13 0x00005648a88a333b in XLogReadAhead (state=0x5648ab673f00, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [14:13:01.126] result = [14:13:01.126] #14 0x00005648a888dc7d in XLogPrefetcherNextBlock (pgsr_private=94870113307952, lsn=0x5648ab6d8708) at ../src/backend/access/transam/xlogprefetcher.c:492 [14:13:01.126] nonblocking = [14:13:01.126] record = [14:13:01.126] prefetcher = 0x5648ab674d30 [14:13:01.126] reader = 0x5648ab673f00 [14:13:01.126] replaying_lsn = 67109152 [14:13:01.126] __func__ = "XLogPrefetcherNextBlock" [14:13:01.126] #15 0x00005648a8892046 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [14:13:01.126] No locals. [14:13:01.126] #16 lrq_complete_lsn (lsn=83886080, lrq=0x5648ab6d8608) at ../src/backend/access/transam/xlogprefetcher.c:290 [14:13:01.126] No locals. [14:13:01.126] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5648ab674d30, errmsg=errmsg@entry=0x7ffd630fe958) at ../src/backend/access/transam/xlogprefetcher.c:1037 [14:13:01.126] record = [14:13:01.126] replayed_up_to = 83886080 [14:13:01.126] #18 0x00005648a8898f10 in ReadRecord (xlogprefetcher=0x5648ab674d30, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [14:13:01.126] errormsg = 0x5648a8d845f1 "AUATUSH\203\354\bH\205\377\017\204:\001" [14:13:01.126] record = [14:13:01.126] xlogreader = 0x5648ab673f00 [14:13:01.126] private = [14:13:01.126] __func__ = "ReadRecord" [14:13:01.126] #19 0x00005648a889c0a7 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [14:13:01.126] xtime = [14:13:01.126] ru0 = {tv = {tv_sec = 1710511755, tv_usec = 749169}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1295}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15788, __ru_maxrss_word = 15788}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 398, __ru_minflt_word = 398}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 2, __ru_nivcsw_word = 2}}} [14:13:01.126] record = 0x7fc37dc811f0 [14:13:01.126] reachedRecoveryTarget = false [14:13:01.145] replayTLI = 1 [14:13:01.145] __func__ = "PerformWalRecovery" [14:13:01.145] #20 0x00005648a8885d54 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [14:13:01.145] Insert = [14:13:01.145] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1710511754, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [14:13:01.145] wasShutdown = false [14:13:01.145] didCrash = [14:13:01.145] haveTblspcMap = false [14:13:01.145] haveBackupLabel = false [14:13:01.145] EndOfLog = [14:13:01.145] EndOfLogTLI = [14:13:01.145] newTLI = [14:13:01.145] performedWalRecovery = [14:13:01.145] endOfRecoveryInfo = [14:13:01.145] abortedRecPtr = [14:13:01.145] missingContrecPtr = [14:13:01.145] oldestActiveXID = [14:13:01.145] promoted = false [14:13:01.145] __func__ = "StartupXLOG" [14:13:01.145] #21 0x00005648a8d3660b in StartupProcessMain () at ../src/backend/postmaster/startup.c:252 [14:13:01.145] No locals. [14:13:01.145] #22 0x00005648a8d26b24 in AuxiliaryProcessMain (auxtype=auxtype@entry=B_STARTUP) at ../src/backend/postmaster/auxprocess.c:91 [14:13:01.145] __func__ = "AuxiliaryProcessMain" [14:13:01.145] #23 0x00005648a8d318c5 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:5336 [14:13:01.145] pid = [14:13:01.145] __func__ = "StartChildProcess" [14:13:01.145] #24 0x00005648a8d35d99 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5648ab672dd0) at ../src/backend/postmaster/postmaster.c:1470 [14:13:01.145] opt = [14:13:01.145] status = [14:13:01.145] userDoption = [14:13:01.145] listen_addr_saved = false [14:13:01.145] output_config_variable = [14:13:01.145] __func__ = "PostmasterMain" [14:13:01.145] #25 0x00005648a8b6106b in main (argc=4, argv=0x5648ab672dd0) at ../src/backend/main/main.c:197 [14:13:01.145] do_check_root = [14:13:01.145] [14:13:01.145] Thread 1 (LWP 26367): [14:13:01.145] #0 0x00007fc380a30fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.145] No symbol table info available. [14:13:01.145] #1 0x00007fc380ae213a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.145] No symbol table info available. [14:13:01.145] #2 0x00007fc380af3a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:13:01.145] No symbol table info available.