[06:50:27.003] src/tools/ci/cores_backtrace.sh linux /tmp/cores [06:50:27.733] dumping /tmp/cores/postgres-3-24604.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [06:50:30.501] [New LWP 24604] [06:50:30.501] [New LWP 24425] [06:50:30.501] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [06:50:31.263] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [06:50:32.189] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [06:50:33.447] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [06:50:36.011] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [06:50:36.011] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [06:50:38.082] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [06:50:39.293] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [06:50:40.952] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [06:50:42.061] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [06:50:42.845] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [06:50:44.076] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [06:50:45.690] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [06:50:47.184] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [06:50:48.093] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [06:50:49.626] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [06:50:51.191] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [06:50:51.662] [Thread debugging using libthread_db enabled] [06:50:51.662] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [06:50:52.885] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [06:50:54.315] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [06:50:55.374] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [06:50:55.996] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [06:50:56.831] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [06:50:59.343] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [06:51:00.286] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [06:51:01.106] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [06:51:02.381] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [06:51:03.307] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [06:51:04.990] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [06:51:06.101] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [06:51:06.891] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [06:51:08.322] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [06:51:08.943] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [06:51:10.470] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [06:51:11.230] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [06:51:12.449] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [06:51:13.235] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [06:51:14.339] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [06:51:15.322] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [06:51:16.589] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [06:51:17.214] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [06:51:18.150] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [06:51:18.927] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [06:51:19.423] Core was generated by `postgres: replica_success: startup waiting for 000000010000000000000004 '. [06:51:19.423] Program terminated with signal SIGQUIT, Quit. [06:51:19.423] #0 0x00007f7076494fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.451] [Current thread is 1 (LWP 24604)] [06:51:19.572] [06:51:19.572] Thread 2 (Thread 0x7f7073e2ba40 (LWP 24425)): [06:51:19.572] #0 0x00007f7076557a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.572] No symbol table info available. [06:51:19.572] #1 0x00007f7076545e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.572] No symbol table info available. [06:51:19.572] #2 0x00007f7076546497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.572] No symbol table info available. [06:51:19.572] #3 0x00007f7076545cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.572] No symbol table info available. [06:51:19.572] #4 0x00007f70764a1a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.572] No symbol table info available. [06:51:19.572] #5 0x0000562f21bd64c6 in RestoreArchivedFile (path=path@entry=0x7ffffbef6af0 "\001", xlogfname=xlogfname@entry=0x7ffffbef6ab0 "00000002.history", recovername=recovername@entry=0x562f226e79f0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [06:51:19.572] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\231\316S\"/V\000\062", '\000' , "\b\000\000\000\000\000\000\000\271\347m\"/V\000\000\330i\357\373\377\177\000\000\265\347m\"/V\000\000\305\311S\"/V\000\000\301\347m\"/V\000\000\271\347m\"/V\000\000\330i\357\373\377\177\000\000\265\347m\"/V\000\000\030\271\342sp\177\000\000c\323S\"/V", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [06:51:19.572] xlogRestoreCmd = 0x562f24b79618 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/042_low_level_backup/data/t_042_low_level_backup_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [06:51:19.572] lastRestartPointFname = '0' , "\000\334S\"/V", '\000' , "\060e\357\373\377\177\000\000c\323S\"/V", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [06:51:19.572] rc = [06:51:19.572] stat_buf = {st_dev = 140120957303064, st_ino = 206734349345, st_nlink = 0, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 48, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3760840147356102704, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 94760441102796, 140737420158328}} [06:51:19.572] restartSegNo = [06:51:19.572] restartRedoPtr = 94760439369369 [06:51:19.572] restartTli = 0 [06:51:19.572] __func__ = "RestoreArchivedFile" [06:51:19.572] #6 0x0000562f21baaeaf in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [06:51:19.572] path = "\001", '\000' , "\001\000\000\000\000\000\000\000\310U\276!/V\000\000 o\357\373\377\177\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "4\000\000\000\000\000\000\000\000\000\002`\016#/V\000\000\200`\016#/V\000\000\240\037\000\000\377\377\002\000\030\342y\"/V\000\000\021`\016#/V\000\000\200`\016#/V\000\000\304l\357\373\377\177\000\000'\342y\"/V\000\000\200`\016#/V\000\000\002\000\000\000\000\000\000\000\302\343S\"/V\000\000", '\177' , "\000\000\000\000\000\000\000\000\000\000"... [06:51:19.572] histfname = "00000002.history\000\360\f#/V\000\000\234\001\000\000\000\000\000\000\001\000\000\000\000\000\000\000\070f\262$/V\000\000Ƚ\270$/V\000\000\001\000\000\000\000\000\000" [06:51:19.572] fd = [06:51:19.572] __func__ = "existsTimeLineHistory" [06:51:19.572] #7 0x0000562f21baaf9a in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [06:51:19.572] newestTLI = 1 [06:51:19.572] probeTLI = 2 [06:51:19.572] #8 0x0000562f21be1491 in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=67108864) at ../src/backend/access/transam/xlogrecovery.c:4113 [06:51:19.572] newExpectedTLEs = [06:51:19.572] found = [06:51:19.572] cell = [06:51:19.572] newtarget = [06:51:19.572] oldtarget = 1 [06:51:19.572] currentTle = 0x0 [06:51:19.572] __func__ = "rescanLatestTimeLine" [06:51:19.572] #9 0x0000562f21be6641 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=67108888, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=67108864, replayTLI=1, replayLSN=67108864, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [06:51:19.572] oldSource = XLOG_FROM_STREAM [06:51:19.572] startWalReceiver = false [06:51:19.572] last_fail_time = 768034065629536 [06:51:19.572] now = [06:51:19.572] streaming_reply_sent = false [06:51:19.572] __func__ = "WaitForWALToBecomeAvailable" [06:51:19.572] #10 0x0000562f21be7077 in XLogPageRead (xlogreader=0x562f24b26f60, targetPagePtr=67108864, reqLen=24, targetRecPtr=67108864, readBuf=0x562f24b75de8 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [06:51:19.572] private = 0x562f24b26f40 [06:51:19.572] emode = 15 [06:51:19.572] targetPageOff = 0 [06:51:19.572] targetSegNo = 4 [06:51:19.572] r = [06:51:19.572] __func__ = "XLogPageRead" [06:51:19.572] #11 0x0000562f21bef4d2 in ReadPageInternal (state=state@entry=0x562f24b26f60, pageptr=pageptr@entry=67108864, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [06:51:19.572] readLen = [06:51:19.572] targetPageOff = 0 [06:51:19.572] targetSegNo = 4 [06:51:19.572] hdr = [06:51:19.572] #12 0x0000562f21bf112d in XLogDecodeNextRecord (state=state@entry=0x562f24b26f60, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [06:51:19.572] RecPtr = 67108864 [06:51:19.572] record = [06:51:19.572] targetPagePtr = 67108864 [06:51:19.572] randAccess = false [06:51:19.572] len = [06:51:19.572] total_len = [06:51:19.572] targetRecOff = 0 [06:51:19.572] pageHeaderSize = [06:51:19.572] assembled = false [06:51:19.572] gotheader = [06:51:19.572] readOff = [06:51:19.572] decoded = 0x0 [06:51:19.572] errormsg = 0x40000000062 [06:51:19.572] #13 0x0000562f21bf1ccf in XLogReadAhead (state=0x562f24b26f60, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [06:51:19.572] result = [06:51:19.572] #14 0x0000562f21bdc611 in XLogPrefetcherNextBlock (pgsr_private=94760479128976, lsn=0x562f24b8b948) at ../src/backend/access/transam/xlogprefetcher.c:492 [06:51:19.572] nonblocking = [06:51:19.572] record = [06:51:19.572] prefetcher = 0x562f24b27d90 [06:51:19.572] reader = 0x562f24b26f60 [06:51:19.572] replaying_lsn = 50331936 [06:51:19.572] __func__ = "XLogPrefetcherNextBlock" [06:51:19.572] #15 0x0000562f21be09da in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [06:51:19.572] No locals. [06:51:19.572] #16 lrq_complete_lsn (lsn=67108864, lrq=0x562f24b8b698) at ../src/backend/access/transam/xlogprefetcher.c:290 [06:51:19.572] No locals. [06:51:19.572] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x562f24b27d90, errmsg=errmsg@entry=0x7ffffbefb238) at ../src/backend/access/transam/xlogprefetcher.c:1037 [06:51:19.572] record = [06:51:19.572] replayed_up_to = 67108864 [06:51:19.572] #18 0x0000562f21be78a4 in ReadRecord (xlogprefetcher=0x562f24b27d90, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [06:51:19.572] errormsg = 0x562f220e98ab "AUATUSH\203\354\bH\205\377\017\204:\001" [06:51:19.572] record = [06:51:19.572] xlogreader = 0x562f24b26f60 [06:51:19.572] private = [06:51:19.572] __func__ = "ReadRecord" [06:51:19.572] #19 0x0000562f21beaa3b in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [06:51:19.572] xtime = [06:51:19.572] ru0 = {tv = {tv_sec = 1714718864, tv_usec = 980724}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1656}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16348, __ru_maxrss_word = 16348}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 405, __ru_minflt_word = 405}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [06:51:19.572] record = 0x7f70736ffe38 [06:51:19.572] reachedRecoveryTarget = false [06:51:19.592] replayTLI = 1 [06:51:19.592] __func__ = "PerformWalRecovery" [06:51:19.592] #20 0x0000562f21bd445e in StartupXLOG () at ../src/backend/access/transam/xlog.c:5806 [06:51:19.592] Insert = [06:51:19.592] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 738}, nextOid = 14202, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1714718861, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 738} [06:51:19.592] wasShutdown = false [06:51:19.592] didCrash = [06:51:19.592] haveTblspcMap = false [06:51:19.592] haveBackupLabel = true [06:51:19.592] EndOfLog = [06:51:19.592] EndOfLogTLI = [06:51:19.592] newTLI = [06:51:19.592] performedWalRecovery = [06:51:19.592] endOfRecoveryInfo = [06:51:19.592] abortedRecPtr = [06:51:19.592] missingContrecPtr = [06:51:19.592] oldestActiveXID = [06:51:19.592] promoted = false [06:51:19.592] __func__ = "StartupXLOG" [06:51:19.592] #21 0x0000562f2209b8ef in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [06:51:19.592] No locals. [06:51:19.592] #22 0x0000562f22092f0b in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [06:51:19.592] pid = [06:51:19.592] #23 0x0000562f22094f84 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [06:51:19.592] pid = [06:51:19.592] __func__ = "StartChildProcess" [06:51:19.592] #24 0x0000562f2209b04e in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x562f24b25df0) at ../src/backend/postmaster/postmaster.c:1364 [06:51:19.592] opt = [06:51:19.592] status = [06:51:19.592] userDoption = [06:51:19.592] listen_addr_saved = false [06:51:19.592] output_config_variable = [06:51:19.592] __func__ = "PostmasterMain" [06:51:19.592] #25 0x0000562f21ebb767 in main (argc=4, argv=0x562f24b25df0) at ../src/backend/main/main.c:197 [06:51:19.592] do_check_root = [06:51:19.592] [06:51:19.592] Thread 1 (LWP 24604): [06:51:19.592] #0 0x00007f7076494fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.592] No symbol table info available. [06:51:19.592] #1 0x00007f707654613a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.592] No symbol table info available. [06:51:19.592] #2 0x00007f7076557a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:51:19.592] No symbol table info available.