[11:27:51.931] src/tools/ci/cores_backtrace.sh linux /tmp/cores [11:27:52.762] dumping /tmp/cores/postgres-3-28072.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [11:27:54.618] [New LWP 28072] [11:27:54.618] [New LWP 27086] [11:27:54.618] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [11:27:55.389] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [11:27:56.314] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [11:27:57.596] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [11:28:00.194] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [11:28:00.194] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [11:28:02.258] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [11:28:03.471] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [11:28:05.098] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [11:28:06.197] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [11:28:06.984] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [11:28:08.285] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [11:28:09.985] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [11:28:11.430] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [11:28:12.349] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [11:28:13.885] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [11:28:15.419] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [11:28:15.890] [Thread debugging using libthread_db enabled] [11:28:15.890] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [11:28:17.092] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [11:28:18.518] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [11:28:19.580] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [11:28:20.204] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [11:28:21.057] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [11:28:23.535] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [11:28:24.471] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [11:28:25.293] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [11:28:26.564] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [11:28:27.507] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [11:28:29.150] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [11:28:30.247] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [11:28:31.037] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [11:28:32.498] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [11:28:33.136] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [11:28:34.671] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [11:28:35.438] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [11:28:36.665] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [11:28:37.463] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [11:28:38.582] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [11:28:39.535] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [11:28:40.802] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [11:28:41.440] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [11:28:42.392] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [11:28:43.175] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [11:28:43.690] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [11:28:43.690] Program terminated with signal SIGQUIT, Quit. [11:28:43.690] #0 0x00007f2bd735ffc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.725] [Current thread is 1 (LWP 28072)] [11:28:43.938] [11:28:43.938] Thread 2 (Thread 0x7f2bd4cf6a40 (LWP 27086)): [11:28:43.938] #0 0x00007f2bd7422a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.938] No symbol table info available. [11:28:43.938] #1 0x00007f2bd7410e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.938] No symbol table info available. [11:28:43.938] #2 0x00007f2bd7411497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.938] No symbol table info available. [11:28:43.938] #3 0x00007f2bd7410cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.938] No symbol table info available. [11:28:43.938] #4 0x00007f2bd736ca69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.938] No symbol table info available. [11:28:43.938] #5 0x0000556ab3f83bd6 in RestoreArchivedFile (path=path@entry=0x7ffd0208abe0 "\200\257\b\002\375\177", xlogfname=xlogfname@entry=0x7ffd0208b030 "00000001", '0' , "5", recovername=recovername@entry=0x556ab4a94a7c "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [11:28:43.938] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "pg_wal/000000015", '0' , '\000' , "\b\000\000\000\000\000\000\000l\022\251\264jU\000\000\b\253\b\002\375\177\000\000`\022\251\264jU\000\000\276\240\216\264jU\000\000\060\260\b\002\375\177\000\000\067J\251\264jU\000\000\b\253\b\002\375\177\000\000\065J\251\264jU\000\000\030i\317\324+\177\000\000\032\253\216\264jU", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [11:28:43.938] xlogRestoreCmd = 0x556ab6feb508 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000001", '0' , "5\" \"pg_wal/RECOVERYXLOG\"" [11:28:43.938] lastRestartPointFname = "00000001", '0' , "2\000\253\216\264jU", '\000' , "\001\000\000\\m\000\000\300vO\327+\177\000\000`wO\327+\177\000\000\\m\000\000\002", '\000' , "\020\315\066\327+\177\000\000У\b\002\375\177", '\000' , "W\301K\327+\177\000\000O\301K\327+\177\000\000\b\265\376\266jU", '\000' , "@", '\000' ... [11:28:43.938] rc = [11:28:43.938] stat_buf = {st_dev = 93916784128674, st_ino = 335544320, st_nlink = 139826270960992, st_mode = 0, st_uid = 0, st_gid = 1003, __pad0 = 0, st_rdev = 11276314736433439744, st_size = 16777216, st_blksize = 93916825040136, st_blocks = 140724637574608, st_atim = {tv_sec = 140724637574192, tv_nsec = 140724637574320}, st_mtim = {tv_sec = 0, tv_nsec = 93916825040136}, st_ctim = {tv_sec = 139826271687831, tv_nsec = 0}, __glibc_reserved = {93916784140478, 140724637577280, 93916785873337}} [11:28:43.938] restartSegNo = [11:28:43.938] restartRedoPtr = 33563696 [11:28:43.938] restartTli = 1 [11:28:43.938] __func__ = "RestoreArchivedFile" [11:28:43.938] #6 0x0000556ab3f92866 in XLogFileRead (segno=140724637577184, segno@entry=5, emode=emode@entry=13, tli=tli@entry=1, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4209 [11:28:43.938] xlogfname = "00000001", '0' , "5\000history\000\000\000\000\000\000\000\000X\205\371\266jU\000\000\005\000\000\000\002\000\000\000\004\000\000\t\000\000\000" [11:28:43.938] activitymsg = "waiting for 00000001", '0' , "5\000\177\000\000\276\240\216\264jU\000\000\360\262\264\264jU\000\000\355\262\264\264jU\000\000H\263\b\002\375\177\000\000벴\264jU\000" [11:28:43.938] path = "\200\257\b\002\375\177\000\000\200\257\b\002\000\000\000\000\001\000\000\000\000\000\000\000z\237\216\264jU\000\000pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\222\245\216\264jU\000\062", '\000' , "\b\000\000\000\000\000\000\000Y\270\250\264jU\000\000h\257\b\002\375\177\000\000U\270\250\264jU\000\000\276\240\216\264jU\000\000a\270\250\264jU\000\000Y\270\250\264jU\000\000h\257\b\002\375\177\000\000U\270\250\264jU\000\000\030i\317\324+\177\000\000\\\252\216\264jU", '\000' ... [11:28:43.938] fd = [11:28:43.938] __func__ = "XLogFileRead" [11:28:43.938] #7 0x0000556ab3f92a56 in XLogFileReadAnyTLI (segno=5, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4337 [11:28:43.938] hent = [11:28:43.938] tli = 1 [11:28:43.938] cell__state = {l = , i = } [11:28:43.938] path = "\267\071\251\264jU\000\000\030i\317\324+\177\000\000p\263\b\002\375\177\000\000\376\262\216\264jU\000\000\000\000\000\000\000\000\000\000b=I\265jU\000\000\340=I\265jU\000\000\064\262\b\002\375\177\000\000\030\262\264\264jU\000\000q=I\265jU\000\000\340=I\265jU\000\000T\262\b\002\375\177\000\000'\262\264\264jU\000\000\340=I\265jU\000\000\002\000\000\000\000\000\000\000\273\272\216\264jU\000\000V\262\b\002\375\177\000\000T\262\b\002\375\177", '\000' , "SSA\030\000\000\000\060\000\000\000\060\262\b\002\375\177\000\000\224\273\216\264jU\000\000\210\246\b\002\375\177\000\000"... [11:28:43.938] cell = [11:28:43.938] fd = [11:28:43.938] tles = 0x556ab6ffdcb8 [11:28:43.938] __func__ = "XLogFileReadAnyTLI" [11:28:43.938] #8 0x0000556ab3f93c52 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3770 [11:28:43.938] oldSource = [11:28:43.938] startWalReceiver = false [11:28:43.938] last_fail_time = 768137080666510 [11:28:43.938] now = [11:28:43.938] streaming_reply_sent = false [11:28:43.938] __func__ = "WaitForWALToBecomeAvailable" [11:28:43.938] #9 0x0000556ab3f94787 in XLogPageRead (xlogreader=0x556ab6f98e80, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x556ab6fe7cd8 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [11:28:43.938] private = 0x556ab6f98e60 [11:28:43.938] emode = 15 [11:28:43.938] targetPageOff = 0 [11:28:43.938] targetSegNo = 5 [11:28:43.938] r = [11:28:43.938] __func__ = "XLogPageRead" [11:28:43.938] #10 0x0000556ab3f9cbe2 in ReadPageInternal (state=state@entry=0x556ab6f98e80, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [11:28:43.938] readLen = [11:28:43.938] targetPageOff = 0 [11:28:43.938] targetSegNo = 5 [11:28:43.938] hdr = [11:28:43.938] #11 0x0000556ab3f9e83d in XLogDecodeNextRecord (state=state@entry=0x556ab6f98e80, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [11:28:43.938] RecPtr = 83886080 [11:28:43.938] record = [11:28:43.938] targetPagePtr = 83886080 [11:28:43.938] randAccess = false [11:28:43.938] len = [11:28:43.938] total_len = [11:28:43.938] targetRecOff = 0 [11:28:43.938] pageHeaderSize = [11:28:43.938] assembled = false [11:28:43.938] gotheader = [11:28:43.938] readOff = [11:28:43.938] decoded = 0x0 [11:28:43.938] errormsg = 0x556ab6f98e80 "\"E\371\263jU" [11:28:43.938] #12 0x0000556ab3f9f3df in XLogReadAhead (state=0x556ab6f98e80, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [11:28:43.938] result = [11:28:43.938] #13 0x0000556ab3f89d21 in XLogPrefetcherNextBlock (pgsr_private=93916824706224, lsn=0x556ab6ffd688) at ../src/backend/access/transam/xlogprefetcher.c:492 [11:28:43.938] nonblocking = [11:28:43.938] record = [11:28:43.938] prefetcher = 0x556ab6f99cb0 [11:28:43.938] reader = 0x556ab6f98e80 [11:28:43.938] replaying_lsn = 67109152 [11:28:43.938] __func__ = "XLogPrefetcherNextBlock" [11:28:43.938] #14 0x0000556ab3f8e0ea in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [11:28:43.938] No locals. [11:28:43.938] #15 lrq_complete_lsn (lsn=83886080, lrq=0x556ab6ffd588) at ../src/backend/access/transam/xlogprefetcher.c:290 [11:28:43.938] No locals. [11:28:43.938] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x556ab6f99cb0, errmsg=errmsg@entry=0x7ffd0208f7c8) at ../src/backend/access/transam/xlogprefetcher.c:1037 [11:28:43.938] record = [11:28:43.938] replayed_up_to = 83886080 [11:28:43.938] #17 0x0000556ab3f94fb4 in ReadRecord (xlogprefetcher=0x556ab6f99cb0, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [11:28:43.938] errormsg = 0x556ab4496fab "AUATUSH\203\354\bH\205\377\017\204:\001" [11:28:43.938] record = [11:28:43.938] xlogreader = 0x556ab6f98e80 [11:28:43.938] private = [11:28:43.961] __func__ = "ReadRecord" [11:28:43.961] #18 0x0000556ab3f9814b in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [11:28:43.961] xtime = [11:28:43.961] ru0 = {tv = {tv_sec = 1714821876, tv_usec = 985455}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1527}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15804, __ru_maxrss_word = 15804}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 393, __ru_minflt_word = 393}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [11:28:43.961] record = 0x7f2bd45b01f0 [11:28:43.961] reachedRecoveryTarget = false [11:28:43.961] replayTLI = 1 [11:28:43.961] __func__ = "PerformWalRecovery" [11:28:43.961] #19 0x0000556ab3f81b6e in StartupXLOG () at ../src/backend/access/transam/xlog.c:5806 [11:28:43.961] Insert = [11:28:43.961] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1714821874, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [11:28:43.961] wasShutdown = false [11:28:43.961] didCrash = [11:28:43.961] haveTblspcMap = false [11:28:43.961] haveBackupLabel = false [11:28:43.961] EndOfLog = [11:28:43.961] EndOfLogTLI = [11:28:43.961] newTLI = [11:28:43.961] performedWalRecovery = [11:28:43.961] endOfRecoveryInfo = [11:28:43.961] abortedRecPtr = [11:28:43.961] missingContrecPtr = [11:28:43.961] oldestActiveXID = [11:28:43.961] promoted = false [11:28:43.961] __func__ = "StartupXLOG" [11:28:43.961] #20 0x0000556ab4448fef in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [11:28:43.961] No locals. [11:28:43.961] #21 0x0000556ab444060b in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [11:28:43.961] pid = [11:28:43.961] #22 0x0000556ab4442684 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [11:28:43.961] pid = [11:28:43.961] __func__ = "StartChildProcess" [11:28:43.961] #23 0x0000556ab444874e in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x556ab6f97d50) at ../src/backend/postmaster/postmaster.c:1364 [11:28:43.961] opt = [11:28:43.961] status = [11:28:43.961] userDoption = [11:28:43.961] listen_addr_saved = false [11:28:43.961] output_config_variable = [11:28:43.961] __func__ = "PostmasterMain" [11:28:43.961] #24 0x0000556ab4268e67 in main (argc=4, argv=0x556ab6f97d50) at ../src/backend/main/main.c:197 [11:28:43.961] do_check_root = [11:28:43.961] [11:28:43.961] Thread 1 (LWP 28072): [11:28:43.961] #0 0x00007f2bd735ffc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.961] No symbol table info available. [11:28:43.961] #1 0x00007f2bd741113a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.961] No symbol table info available. [11:28:43.961] #2 0x00007f2bd7422a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [11:28:43.961] No symbol table info available.