[06:18:52.380] src/tools/ci/cores_backtrace.sh linux /tmp/cores [06:18:53.083] dumping /tmp/cores/postgres-3-30068.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [06:18:54.954] [New LWP 30068] [06:18:54.954] [New LWP 29050] [06:18:54.954] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [06:18:55.749] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [06:18:56.679] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [06:18:59.140] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [06:19:01.891] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [06:19:01.891] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [06:19:04.019] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [06:19:05.283] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [06:19:07.011] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [06:19:08.164] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [06:19:08.993] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [06:19:10.382] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [06:19:12.152] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [06:19:13.678] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [06:19:14.625] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [06:19:16.224] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [06:19:17.829] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [06:19:18.320] [Thread debugging using libthread_db enabled] [06:19:18.320] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [06:19:19.440] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [06:19:20.925] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [06:19:22.033] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [06:19:22.709] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [06:19:23.585] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [06:19:26.180] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [06:19:27.166] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [06:19:28.017] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [06:19:29.323] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [06:19:30.313] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [06:19:32.045] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [06:19:33.196] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [06:19:34.023] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [06:19:35.530] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [06:19:36.201] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [06:19:37.798] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [06:19:38.593] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [06:19:39.869] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [06:19:40.703] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [06:19:41.862] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [06:19:42.865] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [06:19:44.180] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [06:19:44.845] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [06:19:45.847] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [06:19:46.676] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [06:19:47.187] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [06:19:47.187] Program terminated with signal SIGQUIT, Quit. [06:19:47.187] #0 0x00007f1400d29fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.215] [Current thread is 1 (LWP 30068)] [06:19:47.323] [06:19:47.323] Thread 2 (Thread 0x7f13fe6c0a40 (LWP 29050)): [06:19:47.323] #0 0x00007f1400deca61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.323] No symbol table info available. [06:19:47.323] #1 0x00007f1400ddae5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.323] No symbol table info available. [06:19:47.323] #2 0x00007f1400ddb497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.323] No symbol table info available. [06:19:47.323] #3 0x00007f1400ddacdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.323] No symbol table info available. [06:19:47.323] #4 0x00007f1400d36a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.323] No symbol table info available. [06:19:47.323] #5 0x00005561fb94290b in RestoreArchivedFile (path=path@entry=0x7ffcf86ab080 "\001", xlogfname=xlogfname@entry=0x7ffcf86ab040 "00000002.history", recovername=recovername@entry=0x5561fc4130f0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:178 [06:19:47.323] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\302\215'\374aU\000\062", '\000' , "\b\000\000\000\000\000\000\000I\240@\374aU\000\000h\257j\370\374\177\000\000E\240@\374aU\000\000\356\210'\374aU\000\000Q\240@\374aU\000\000I\240@\374aU\000\000h\257j\370\374\177\000\000E\240@\374aU\000\000\030\tl\376\023\177\000\000\214\222'\374aU", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [06:19:47.323] xlogRestoreCmd = 0x5561fe419878 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [06:19:47.323] lastRestartPointFname = '0' , "\000\233'\374aU", '\000' , "\300\252j\370\374\177\000\000\214\222'\374aU", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [06:19:47.323] rc = [06:19:47.323] stat_buf = {st_dev = 32768, st_ino = 207866926367, st_nlink = 859055093, st_mode = 1708496159, st_uid = 0, st_gid = 687055255, __pad0 = 0, st_rdev = 1708496159, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3832897741394030640, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 93879332305092, 140724476226312}} [06:19:47.323] restartSegNo = [06:19:47.323] restartRedoPtr = 93879330639298 [06:19:47.323] restartTli = 0 [06:19:47.323] __func__ = "RestoreArchivedFile" [06:19:47.323] #6 0x00005561fb918cfc in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [06:19:47.323] path = "\001", '\000' , "\001\000\000\000\000\000\000\000\r\032\225\373aU\000\000< A\374aU\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "5\000\000\000\000\000\000\000\000\000\242\264\333\374aU\000\000 \265\333\374aU\000\000\064\262j\370\374\177\000\000x\031L\374aU\000\000\261\264\333\374aU\000\000 \265\333\374aU\000\000T\262j\370\374\177\000\000\207\031L\374aU\000\000 \265\333\374aU\000\000\002\000\000\000\000\000\000\000\353\242'\374aU\000\000V\262j\370\374\177\000\000T\262j\370\374\177", '\000' ... [06:19:47.323] histfname = "00000002.history\000\000\000\000\000\000\000\000\210e<\376aU\000\000\a\000\000\000\002\000\000\000\004\000\000\t\000\000\000\000(\300B\376aU\000\000\001\000\000\000\000\000\000" [06:19:47.323] fd = [06:19:47.323] __func__ = "existsTimeLineHistory" [06:19:47.323] #7 0x00005561fb918de7 in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [06:19:47.323] newestTLI = 1 [06:19:47.323] probeTLI = 2 [06:19:47.323] #8 0x00005561fb94d8d6 in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=83886080) at ../src/backend/access/transam/xlogrecovery.c:4095 [06:19:47.323] newExpectedTLEs = [06:19:47.323] found = [06:19:47.323] cell = [06:19:47.323] newtarget = [06:19:47.323] oldtarget = 1 [06:19:47.323] currentTle = 0x0 [06:19:47.323] __func__ = "rescanLatestTimeLine" [06:19:47.323] #9 0x00005561fb952a86 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3656 [06:19:47.323] oldSource = XLOG_FROM_STREAM [06:19:47.323] startWalReceiver = false [06:19:47.323] last_fail_time = 761811363481171 [06:19:47.323] now = [06:19:47.323] streaming_reply_sent = false [06:19:47.323] __func__ = "WaitForWALToBecomeAvailable" [06:19:47.323] #10 0x00005561fb9534bc in XLogPageRead (xlogreader=0x5561fe3c6eb0, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x5561fe416048 "\024\321\002") at ../src/backend/access/transam/xlogrecovery.c:3333 [06:19:47.323] private = 0x5561fe3c6e90 [06:19:47.323] emode = 15 [06:19:47.323] targetPageOff = 0 [06:19:47.323] targetSegNo = 5 [06:19:47.323] r = [06:19:47.323] __func__ = "XLogPageRead" [06:19:47.323] #11 0x00005561fb95b8dc in ReadPageInternal (state=state@entry=0x5561fe3c6eb0, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1062 [06:19:47.323] readLen = [06:19:47.323] targetPageOff = 0 [06:19:47.323] targetSegNo = 5 [06:19:47.323] hdr = [06:19:47.323] #12 0x00005561fb95d537 in XLogDecodeNextRecord (state=state@entry=0x5561fe3c6eb0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:599 [06:19:47.323] RecPtr = 83886080 [06:19:47.323] record = [06:19:47.323] targetPagePtr = 83886080 [06:19:47.323] randAccess = false [06:19:47.323] len = [06:19:47.323] total_len = [06:19:47.323] targetRecOff = 0 [06:19:47.323] pageHeaderSize = [06:19:47.323] assembled = false [06:19:47.323] gotheader = [06:19:47.323] readOff = [06:19:47.323] decoded = 0x0 [06:19:47.323] errormsg = 0x5561fb92dd4d "\204\300\017\205q\001" [06:19:47.323] #13 0x00005561fb95e0d9 in XLogReadAhead (state=0x5561fe3c6eb0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:975 [06:19:47.323] result = [06:19:47.323] #14 0x00005561fb948a56 in XLogPrefetcherNextBlock (pgsr_private=93879365565664, lsn=0x5561fe42b9f8) at ../src/backend/access/transam/xlogprefetcher.c:496 [06:19:47.323] nonblocking = [06:19:47.323] record = [06:19:47.323] prefetcher = 0x5561fe3c7ce0 [06:19:47.323] reader = 0x5561fe3c6eb0 [06:19:47.323] replaying_lsn = 67109152 [06:19:47.323] __func__ = "XLogPrefetcherNextBlock" [06:19:47.323] #15 0x00005561fb94ce1f in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:256 [06:19:47.323] No locals. [06:19:47.323] #16 lrq_complete_lsn (lsn=83886080, lrq=0x5561fe42b8f8) at ../src/backend/access/transam/xlogprefetcher.c:294 [06:19:47.323] No locals. [06:19:47.323] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5561fe3c7ce0, errmsg=errmsg@entry=0x7ffcf86af7c8) at ../src/backend/access/transam/xlogprefetcher.c:1041 [06:19:47.323] record = [06:19:47.323] replayed_up_to = 83886080 [06:19:47.323] #18 0x00005561fb953ce9 in ReadRecord (xlogprefetcher=0x5561fe3c7ce0, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3133 [06:19:47.323] errormsg = 0x5561fbe3e118 "AUATUSH\203\354\bH\205\377\017\204:\001" [06:19:47.323] record = [06:19:47.323] xlogreader = 0x5561fe3c6eb0 [06:19:47.323] private = [06:19:47.323] __func__ = "ReadRecord" [06:19:47.323] #19 0x00005561fb956e45 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1814 [06:19:47.323] xtime = [06:19:47.323] ru0 = {tv = {tv_sec = 1708496159, tv_usec = 862189}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1264}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15656, __ru_maxrss_word = 15656}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 396, __ru_minflt_word = 396}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [06:19:47.342] record = 0x7f13fe0041f0 [06:19:47.342] reachedRecoveryTarget = false [06:19:47.342] replayTLI = 1 [06:19:47.342] __func__ = "PerformWalRecovery" [06:19:47.342] #20 0x00005561fb940b94 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5733 [06:19:47.342] Insert = [06:19:47.342] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1708496158, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [06:19:47.342] wasShutdown = false [06:19:47.342] didCrash = [06:19:47.342] haveTblspcMap = false [06:19:47.342] haveBackupLabel = false [06:19:47.342] EndOfLog = [06:19:47.342] EndOfLogTLI = [06:19:47.342] newTLI = [06:19:47.342] performedWalRecovery = [06:19:47.342] endOfRecoveryInfo = [06:19:47.342] abortedRecPtr = [06:19:47.342] missingContrecPtr = [06:19:47.342] oldestActiveXID = [06:19:47.342] promoted = false [06:19:47.342] __func__ = "StartupXLOG" [06:19:47.342] #21 0x00005561fbdf13d9 in StartupProcessMain () at ../src/backend/postmaster/startup.c:254 [06:19:47.342] No locals. [06:19:47.342] #22 0x00005561fbde183f in AuxiliaryProcessMain (auxtype=auxtype@entry=StartupProcess) at ../src/backend/postmaster/auxprocess.c:142 [06:19:47.342] __func__ = "AuxiliaryProcessMain" [06:19:47.342] #23 0x00005561fbdec725 in StartChildProcess (type=type@entry=StartupProcess) at ../src/backend/postmaster/postmaster.c:5311 [06:19:47.342] pid = [06:19:47.342] __func__ = "StartChildProcess" [06:19:47.342] #24 0x00005561fbdf0b19 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5561fe3c5d80) at ../src/backend/postmaster/postmaster.c:1459 [06:19:47.342] opt = [06:19:47.342] status = [06:19:47.342] userDoption = [06:19:47.342] listen_addr_saved = false [06:19:47.342] output_config_variable = [06:19:47.342] __func__ = "PostmasterMain" [06:19:47.342] #25 0x00005561fbc1b8af in main (argc=4, argv=0x5561fe3c5d80) at ../src/backend/main/main.c:198 [06:19:47.342] do_check_root = [06:19:47.342] [06:19:47.342] Thread 1 (LWP 30068): [06:19:47.342] #0 0x00007f1400d29fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.342] No symbol table info available. [06:19:47.342] #1 0x00007f1400ddb13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.342] No symbol table info available. [06:19:47.342] #2 0x00007f1400deca6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:19:47.342] No symbol table info available.