[18:05:59.699] src/tools/ci/cores_backtrace.sh linux /tmp/cores [18:06:00.459] dumping /tmp/cores/postgres-3-35108.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [18:06:02.377] [New LWP 35108] [18:06:02.377] [New LWP 35009] [18:06:02.377] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [18:06:03.142] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [18:06:04.091] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [18:06:05.369] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [18:06:08.005] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [18:06:08.005] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [18:06:10.114] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [18:06:11.363] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [18:06:13.050] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [18:06:14.183] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [18:06:15.010] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [18:06:16.379] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [18:06:18.143] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [18:06:19.615] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [18:06:20.538] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [18:06:22.105] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [18:06:23.711] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [18:06:24.195] [Thread debugging using libthread_db enabled] [18:06:24.195] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [18:06:25.455] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [18:06:26.919] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [18:06:27.985] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [18:06:28.630] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [18:06:29.493] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [18:06:32.055] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [18:06:33.021] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [18:06:33.869] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [18:06:35.222] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [18:06:36.186] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [18:06:37.869] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [18:06:38.986] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [18:06:39.803] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [18:06:41.262] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [18:06:41.904] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [18:06:43.439] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [18:06:44.206] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [18:06:45.441] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [18:06:46.252] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [18:06:47.390] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [18:06:48.374] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [18:06:49.661] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [18:06:50.316] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [18:06:51.295] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [18:06:52.106] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [18:06:52.639] Core was generated by `postgres: replica_success: startup waiting for 000000010000000000000004 '. [18:06:52.639] Program terminated with signal SIGQUIT, Quit. [18:06:52.639] #0 0x00007f6cf749cfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.675] [Current thread is 1 (LWP 35108)] [18:06:52.836] [18:06:52.836] Thread 2 (Thread 0x7f6cf4e33a40 (LWP 35009)): [18:06:52.836] #0 0x00007f6cf755fa61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.836] No symbol table info available. [18:06:52.836] #1 0x00007f6cf754de5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.836] No symbol table info available. [18:06:52.836] #2 0x00007f6cf754e497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.836] No symbol table info available. [18:06:52.836] #3 0x00007f6cf754dcdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.836] No symbol table info available. [18:06:52.836] #4 0x00007f6cf74a9a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.836] No symbol table info available. [18:06:52.836] #5 0x0000559d732e7b32 in RestoreArchivedFile (path=path@entry=0x7fff80c9b740 "\001", xlogfname=xlogfname@entry=0x7fff80c9b700 "00000002.history", recovername=recovername@entry=0x559d73dbd5d0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [18:06:52.836] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\252>\302s\235U\000\062", '\000' , "\b\000\000\000\000\000\000\000\031C\333s\235U\000\000(\266ɀ\377\177\000\000\025C\333s\235U\000\000\326\071\302s\235U\000\000!C\333s\235U\000\000\031C\333s\235U\000\000(\266ɀ\377\177\000\000\025C\333s\235U\000\000\030\071\343\364l\177\000\000tC\302s\235U", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [18:06:52.836] xlogRestoreCmd = 0x559d7484b5e8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/042_low_level_backup/data/t_042_low_level_backup_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [18:06:52.836] lastRestartPointFname = '0' , "\000L\302s\235U", '\000' , "\200\261ɀ\377\177\000\000tC\302s\235U", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [18:06:52.836] rc = [18:06:52.836] stat_buf = {st_dev = 140105941727512, st_ino = 208100541490, st_nlink = 0, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 48, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3760840147356102704, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 94134741999004, 140735354089928}} [18:06:52.836] restartSegNo = [18:06:52.836] restartRedoPtr = 94134740336298 [18:06:52.836] restartTli = 0 [18:06:52.836] __func__ = "RestoreArchivedFile" [18:06:52.836] #6 0x0000559d732bdf40 in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [18:06:52.836] path = "\001", '\000' , "\001\000\000\000\000\000\000\000\064l/s\235U\000\000\001\000\000\000\000\000\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "4\000\000\000\000\000\000\000\000\000\240\037\000\000\377\377\002\000\340Kwt\235U\000\000\364\270ɀ\377\177\000\000\370\001\347s\235U\000\000qKwt\235U\000\000\340Kwt\235U\000\000\024\271ɀ\377\177\000\000\a\002\347s\235U\000\000\340Kwt\235U\000\000", '\177' , "\000\000\377", '\000' , "\377", '\000' ... [18:06:52.836] histfname = "00000002.history\000\000\000\000\000\000\000\000\b\206\177t\235U\000\000\a\000\000\000\000\000\000\000\004\000\000\t\000\000\000\000\230݅t\235U\000\000\001\000\000\000\000\000\000" [18:06:52.836] fd = [18:06:52.836] __func__ = "existsTimeLineHistory" [18:06:52.836] #7 0x0000559d732be02b in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [18:06:52.836] newestTLI = 1 [18:06:52.836] probeTLI = 2 [18:06:52.836] #8 0x0000559d732f2afd in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=67108864) at ../src/backend/access/transam/xlogrecovery.c:4113 [18:06:52.836] newExpectedTLEs = [18:06:52.836] found = [18:06:52.836] cell = [18:06:52.836] newtarget = [18:06:52.836] oldtarget = 1 [18:06:52.836] currentTle = 0x0 [18:06:52.836] __func__ = "rescanLatestTimeLine" [18:06:52.836] #9 0x0000559d732f7cad in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=67108888, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=67108864, replayTLI=1, replayLSN=67108864, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [18:06:52.836] oldSource = XLOG_FROM_STREAM [18:06:52.836] startWalReceiver = false [18:06:52.836] last_fail_time = 763927404263799 [18:06:52.836] now = [18:06:52.836] streaming_reply_sent = false [18:06:52.836] __func__ = "WaitForWALToBecomeAvailable" [18:06:52.836] #10 0x0000559d732f86e3 in XLogPageRead (xlogreader=0x559d747f8f30, targetPagePtr=67108864, reqLen=24, targetRecPtr=67108864, readBuf=0x559d74847db8 "\024\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [18:06:52.836] private = 0x559d747f8f10 [18:06:52.836] emode = 15 [18:06:52.836] targetPageOff = 0 [18:06:52.836] targetSegNo = 4 [18:06:52.836] r = [18:06:52.836] __func__ = "XLogPageRead" [18:06:52.836] #11 0x0000559d73300b3e in ReadPageInternal (state=state@entry=0x559d747f8f30, pageptr=pageptr@entry=67108864, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [18:06:52.836] readLen = [18:06:52.836] targetPageOff = 0 [18:06:52.836] targetSegNo = 4 [18:06:52.836] hdr = [18:06:52.836] #12 0x0000559d73302799 in XLogDecodeNextRecord (state=state@entry=0x559d747f8f30, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [18:06:52.836] RecPtr = 67108864 [18:06:52.836] record = [18:06:52.836] targetPagePtr = 67108864 [18:06:52.836] randAccess = false [18:06:52.836] len = [18:06:52.836] total_len = [18:06:52.836] targetRecOff = 0 [18:06:52.836] pageHeaderSize = [18:06:52.836] assembled = false [18:06:52.836] gotheader = [18:06:52.836] readOff = [18:06:52.836] decoded = 0x0 [18:06:52.836] errormsg = 0x40000000062 [18:06:52.836] #13 0x0000559d7330333b in XLogReadAhead (state=0x559d747f8f30, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [18:06:52.836] result = [18:06:52.836] #14 0x0000559d732edc7d in XLogPrefetcherNextBlock (pgsr_private=94134752746848, lsn=0x559d7485d918) at ../src/backend/access/transam/xlogprefetcher.c:492 [18:06:52.836] nonblocking = [18:06:52.836] record = [18:06:52.836] prefetcher = 0x559d747f9d60 [18:06:52.836] reader = 0x559d747f8f30 [18:06:52.836] replaying_lsn = 50331936 [18:06:52.836] __func__ = "XLogPrefetcherNextBlock" [18:06:52.836] #15 0x0000559d732f2046 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [18:06:52.836] No locals. [18:06:52.836] #16 lrq_complete_lsn (lsn=67108864, lrq=0x559d7485d668) at ../src/backend/access/transam/xlogprefetcher.c:290 [18:06:52.836] No locals. [18:06:52.836] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x559d747f9d60, errmsg=errmsg@entry=0x7fff80c9fe88) at ../src/backend/access/transam/xlogprefetcher.c:1037 [18:06:52.836] record = [18:06:52.836] replayed_up_to = 67108864 [18:06:52.836] #18 0x0000559d732f8f10 in ReadRecord (xlogprefetcher=0x559d747f9d60, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [18:06:52.836] errormsg = 0x559d737e4640 "AUATUSH\203\354\bH\205\377\017\204:\001" [18:06:52.836] record = [18:06:52.836] xlogreader = 0x559d747f8f30 [18:06:52.836] private = [18:06:52.836] __func__ = "ReadRecord" [18:06:52.836] #19 0x0000559d732fc0a7 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [18:06:52.836] xtime = [18:06:52.836] ru0 = {tv = {tv_sec = 1710612203, tv_usec = 585279}, ru = {ru_utime = {tv_sec = 0, tv_usec = 2149}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16276, __ru_maxrss_word = 16276}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 404, __ru_minflt_word = 404}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [18:06:52.836] record = 0x7f6cf4707e50 [18:06:52.865] reachedRecoveryTarget = false [18:06:52.865] replayTLI = 1 [18:06:52.865] __func__ = "PerformWalRecovery" [18:06:52.865] #20 0x0000559d732e5d54 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [18:06:52.865] Insert = [18:06:52.865] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 738}, nextOid = 14205, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1710612199, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 738} [18:06:52.865] wasShutdown = false [18:06:52.865] didCrash = [18:06:52.865] haveTblspcMap = false [18:06:52.865] haveBackupLabel = true [18:06:52.865] EndOfLog = [18:06:52.865] EndOfLogTLI = [18:06:52.865] newTLI = [18:06:52.865] performedWalRecovery = [18:06:52.865] endOfRecoveryInfo = [18:06:52.865] abortedRecPtr = [18:06:52.865] missingContrecPtr = [18:06:52.865] oldestActiveXID = [18:06:52.865] promoted = false [18:06:52.865] __func__ = "StartupXLOG" [18:06:52.865] #21 0x0000559d7379665a in StartupProcessMain () at ../src/backend/postmaster/startup.c:252 [18:06:52.865] No locals. [18:06:52.865] #22 0x0000559d73786b73 in AuxiliaryProcessMain (auxtype=auxtype@entry=B_STARTUP) at ../src/backend/postmaster/auxprocess.c:91 [18:06:52.865] __func__ = "AuxiliaryProcessMain" [18:06:52.865] #23 0x0000559d73791914 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:5336 [18:06:52.865] pid = [18:06:52.865] __func__ = "StartChildProcess" [18:06:52.865] #24 0x0000559d73795de8 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x559d747f7dc0) at ../src/backend/postmaster/postmaster.c:1470 [18:06:52.865] opt = [18:06:52.865] status = [18:06:52.865] userDoption = [18:06:52.865] listen_addr_saved = false [18:06:52.865] output_config_variable = [18:06:52.865] __func__ = "PostmasterMain" [18:06:52.865] #25 0x0000559d735c106b in main (argc=4, argv=0x559d747f7dc0) at ../src/backend/main/main.c:197 [18:06:52.865] do_check_root = [18:06:52.865] [18:06:52.865] Thread 1 (LWP 35108): [18:06:52.865] #0 0x00007f6cf749cfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.865] No symbol table info available. [18:06:52.865] #1 0x00007f6cf754e13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.865] No symbol table info available. [18:06:52.865] #2 0x00007f6cf755fa6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [18:06:52.865] No symbol table info available.