[19:49:46.151] src/tools/ci/cores_backtrace.sh linux /tmp/cores [19:49:46.848] dumping /tmp/cores/postgres-3-28677.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [19:49:48.678] [New LWP 28677] [19:49:48.678] [New LWP 28558] [19:49:48.678] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [19:49:49.440] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [19:49:50.353] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [19:49:51.654] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [19:49:54.199] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [19:49:54.199] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [19:49:56.276] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [19:49:57.504] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [19:49:59.157] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [19:50:00.282] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [19:50:01.065] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [19:50:02.395] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [19:50:04.105] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [19:50:05.552] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [19:50:06.463] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [19:50:08.000] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [19:50:09.536] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [19:50:10.008] [Thread debugging using libthread_db enabled] [19:50:10.008] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [19:50:11.239] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [19:50:12.667] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [19:50:13.726] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [19:50:14.349] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [19:50:15.207] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [19:50:17.696] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [19:50:18.635] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [19:50:19.455] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [19:50:20.751] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [19:50:21.682] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [19:50:23.350] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [19:50:24.444] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [19:50:25.226] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [19:50:26.665] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [19:50:27.291] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [19:50:28.822] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [19:50:29.584] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [19:50:30.803] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [19:50:31.591] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [19:50:32.698] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [19:50:33.650] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [19:50:34.908] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [19:50:35.532] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [19:50:36.468] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [19:50:37.247] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [19:50:37.742] Core was generated by `postgres: replica_success: startup waiting for 000000010000000000000004 '. [19:50:37.742] Program terminated with signal SIGQUIT, Quit. [19:50:37.742] #0 0x00007efff8286fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.772] [Current thread is 1 (LWP 28677)] [19:50:37.897] [19:50:37.897] Thread 2 (Thread 0x7efff5c1da40 (LWP 28558)): [19:50:37.897] #0 0x00007efff8349a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.897] No symbol table info available. [19:50:37.897] #1 0x00007efff8337e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.897] No symbol table info available. [19:50:37.897] #2 0x00007efff8338497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.897] No symbol table info available. [19:50:37.897] #3 0x00007efff8337cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.897] No symbol table info available. [19:50:37.897] #4 0x00007efff8293a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.897] No symbol table info available. [19:50:37.897] #5 0x000055ba01dff493 in RestoreArchivedFile (path=path@entry=0x7ffffdb7a0f0 "\001", xlogfname=xlogfname@entry=0x7ffffdb7a0b0 "00000002.history", recovername=recovername@entry=0x55ba0290e9f0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [19:50:37.897] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\034Dv\002\272U\000\062", '\000' , "\b\000\000\000\000\000\000\000\271W\220\002\272U\000\000؟\267\375\377\177\000\000\265W\220\002\272U\000\000H?v\002\272U\000\000\301W\220\002\272U\000\000\271W\220\002\272U\000\000؟\267\375\377\177\000\000\265W\220\002\272U\000\000\030\331\301\365\377~\000\000\346Hv\002\272U", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [19:50:37.897] xlogRestoreCmd = 0x55ba04c246a8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/042_low_level_backup/data/t_042_low_level_backup_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [19:50:37.897] lastRestartPointFname = '0' , "\000Qv\002\272U", '\000' , "\060\233\267\375\377\177\000\000\346Hv\002\272U", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [19:50:37.897] rc = [19:50:37.897] stat_buf = {st_dev = 139637804882200, st_ino = 206199736740, st_nlink = 0, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 48, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3760840147356102704, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 94257395315148, 140737450056568}} [19:50:37.897] restartSegNo = [19:50:37.897] restartRedoPtr = 94257393583132 [19:50:37.897] restartTli = 0 [19:50:37.897] __func__ = "RestoreArchivedFile" [19:50:37.897] #6 0x000055ba01dd3e7c in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [19:50:37.897] path = "\001", '\000' , "\001\000\000\000\000\000\000\000\225\345\340\001\272U\000\000 \245\267\375\377\177\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "4\000\000\000\000\000\000\000\000\000µ0\003\272U\000\000@\266\060\003\272U\000\000\240\037\000\000\377\377\002\000\030B\234\002\272U\000\000ѵ0\003\272U\000\000@\266\060\003\272U\000\000Ģ\267\375\377\177\000\000'B\234\002\272U\000\000@\266\060\003\272U\000\000\002\000\000\000\000\000\000\000EYv\002\272U\000\000", '\177' , "\000\000\000\000\000\000\000\000\000\000\377\377"... [19:50:37.897] histfname = "00000002.history\000E/\003\272U\000\000\263\001\000\000\000\000\000\000\001\000\000\000\000\000\000\000\250\026\275\004\272U\000\000Xn\303\004\272U\000\000\001\000\000\000\000\000\000" [19:50:37.897] fd = [19:50:37.897] __func__ = "existsTimeLineHistory" [19:50:37.897] #7 0x000055ba01dd3f67 in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [19:50:37.897] newestTLI = 1 [19:50:37.897] probeTLI = 2 [19:50:37.897] #8 0x000055ba01e0a45e in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=67108864) at ../src/backend/access/transam/xlogrecovery.c:4113 [19:50:37.897] newExpectedTLEs = [19:50:37.897] found = [19:50:37.897] cell = [19:50:37.897] newtarget = [19:50:37.897] oldtarget = 1 [19:50:37.897] currentTle = 0x0 [19:50:37.897] __func__ = "rescanLatestTimeLine" [19:50:37.897] #9 0x000055ba01e0f60e in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=67108888, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=67108864, replayTLI=1, replayLSN=67108864, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [19:50:37.897] oldSource = XLOG_FROM_STREAM [19:50:37.897] startWalReceiver = false [19:50:37.897] last_fail_time = 767476021827419 [19:50:37.897] now = [19:50:37.897] streaming_reply_sent = false [19:50:37.897] __func__ = "WaitForWALToBecomeAvailable" [19:50:37.897] #10 0x000055ba01e10044 in XLogPageRead (xlogreader=0x55ba04bd1fd0, targetPagePtr=67108864, reqLen=24, targetRecPtr=67108864, readBuf=0x55ba04c20e78 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [19:50:37.897] private = 0x55ba04bd1fb0 [19:50:37.897] emode = 15 [19:50:37.897] targetPageOff = 0 [19:50:37.897] targetSegNo = 4 [19:50:37.897] r = [19:50:37.897] __func__ = "XLogPageRead" [19:50:37.897] #11 0x000055ba01e1849f in ReadPageInternal (state=state@entry=0x55ba04bd1fd0, pageptr=pageptr@entry=67108864, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [19:50:37.897] readLen = [19:50:37.897] targetPageOff = 0 [19:50:37.897] targetSegNo = 4 [19:50:37.897] hdr = [19:50:37.897] #12 0x000055ba01e1a0fa in XLogDecodeNextRecord (state=state@entry=0x55ba04bd1fd0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [19:50:37.897] RecPtr = 67108864 [19:50:37.897] record = [19:50:37.897] targetPagePtr = 67108864 [19:50:37.897] randAccess = false [19:50:37.897] len = [19:50:37.897] total_len = [19:50:37.897] targetRecOff = 0 [19:50:37.897] pageHeaderSize = [19:50:37.897] assembled = false [19:50:37.897] gotheader = [19:50:37.897] readOff = [19:50:37.897] decoded = 0x0 [19:50:37.897] errormsg = 0x40000000062 [19:50:37.897] #13 0x000055ba01e1ac9c in XLogReadAhead (state=0x55ba04bd1fd0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [19:50:37.897] result = [19:50:37.897] #14 0x000055ba01e055de in XLogPrefetcherNextBlock (pgsr_private=94257431784960, lsn=0x55ba04c369d8) at ../src/backend/access/transam/xlogprefetcher.c:492 [19:50:37.897] nonblocking = [19:50:37.897] record = [19:50:37.897] prefetcher = 0x55ba04bd2e00 [19:50:37.897] reader = 0x55ba04bd1fd0 [19:50:37.897] replaying_lsn = 50331936 [19:50:37.897] __func__ = "XLogPrefetcherNextBlock" [19:50:37.897] #15 0x000055ba01e099a7 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [19:50:37.897] No locals. [19:50:37.897] #16 lrq_complete_lsn (lsn=67108864, lrq=0x55ba04c36728) at ../src/backend/access/transam/xlogprefetcher.c:290 [19:50:37.897] No locals. [19:50:37.897] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x55ba04bd2e00, errmsg=errmsg@entry=0x7ffffdb7e838) at ../src/backend/access/transam/xlogprefetcher.c:1037 [19:50:37.897] record = [19:50:37.897] replayed_up_to = 67108864 [19:50:37.897] #18 0x000055ba01e10871 in ReadRecord (xlogprefetcher=0x55ba04bd2e00, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [19:50:37.897] errormsg = 0x55ba02310fba "AUATUSH\203\354\bH\205\377\017\204:\001" [19:50:37.897] record = [19:50:37.897] xlogreader = 0x55ba04bd1fd0 [19:50:37.897] private = [19:50:37.897] __func__ = "ReadRecord" [19:50:37.897] #19 0x000055ba01e13a08 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [19:50:37.897] xtime = [19:50:37.897] ru0 = {tv = {tv_sec = 1714160821, tv_usec = 156868}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1562}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16508, __ru_maxrss_word = 16508}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 408, __ru_minflt_word = 408}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [19:50:37.916] record = 0x7efff54f1e38 [19:50:37.916] reachedRecoveryTarget = false [19:50:37.916] replayTLI = 1 [19:50:37.916] __func__ = "PerformWalRecovery" [19:50:37.916] #20 0x000055ba01dfd42b in StartupXLOG () at ../src/backend/access/transam/xlog.c:5806 [19:50:37.916] Insert = [19:50:37.916] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 738}, nextOid = 14202, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1714160817, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 738} [19:50:37.916] wasShutdown = false [19:50:37.916] didCrash = [19:50:37.916] haveTblspcMap = false [19:50:37.916] haveBackupLabel = true [19:50:37.916] EndOfLog = [19:50:37.916] EndOfLogTLI = [19:50:37.916] newTLI = [19:50:37.916] performedWalRecovery = [19:50:37.916] endOfRecoveryInfo = [19:50:37.916] abortedRecPtr = [19:50:37.916] missingContrecPtr = [19:50:37.916] oldestActiveXID = [19:50:37.916] promoted = false [19:50:37.916] __func__ = "StartupXLOG" [19:50:37.916] #21 0x000055ba022c2ffe in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [19:50:37.916] No locals. [19:50:37.916] #22 0x000055ba022ba61a in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [19:50:37.916] pid = [19:50:37.916] #23 0x000055ba022bc693 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [19:50:37.916] pid = [19:50:37.916] __func__ = "StartChildProcess" [19:50:37.916] #24 0x000055ba022c275d in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x55ba04bd0e60) at ../src/backend/postmaster/postmaster.c:1364 [19:50:37.916] opt = [19:50:37.916] status = [19:50:37.916] userDoption = [19:50:37.916] listen_addr_saved = false [19:50:37.916] output_config_variable = [19:50:37.916] __func__ = "PostmasterMain" [19:50:37.916] #25 0x000055ba020e310d in main (argc=4, argv=0x55ba04bd0e60) at ../src/backend/main/main.c:197 [19:50:37.916] do_check_root = [19:50:37.916] [19:50:37.916] Thread 1 (LWP 28677): [19:50:37.916] #0 0x00007efff8286fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.916] No symbol table info available. [19:50:37.916] #1 0x00007efff833813a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.916] No symbol table info available. [19:50:37.916] #2 0x00007efff8349a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [19:50:37.916] No symbol table info available.