[22:40:23.894] src/tools/ci/cores_backtrace.sh linux /tmp/cores [22:40:24.624] dumping /tmp/cores/postgres-3-27242.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [22:40:26.324] [New LWP 27242] [22:40:26.324] [New LWP 26178] [22:40:26.324] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [22:40:27.090] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [22:40:27.859] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [22:40:29.094] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [22:40:31.482] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [22:40:31.482] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [22:40:33.368] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [22:40:34.603] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [22:40:36.195] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [22:40:37.265] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [22:40:38.038] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [22:40:39.282] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [22:40:40.931] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [22:40:42.369] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [22:40:43.289] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [22:40:44.841] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [22:40:46.230] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [22:40:46.705] [Thread debugging using libthread_db enabled] [22:40:46.705] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [22:40:47.781] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [22:40:49.190] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [22:40:50.256] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [22:40:50.870] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [22:40:51.636] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [22:40:53.935] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [22:40:54.859] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [22:40:55.648] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [22:40:56.593] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [22:40:57.536] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [22:40:59.136] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [22:41:00.202] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [22:41:00.980] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [22:41:02.367] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [22:41:02.984] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [22:41:04.516] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [22:41:05.281] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [22:41:06.517] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [22:41:07.299] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [22:41:08.396] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [22:41:09.343] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [22:41:10.584] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [22:41:11.212] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [22:41:12.151] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [22:41:12.919] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [22:41:13.412] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [22:41:13.412] Program terminated with signal SIGQUIT, Quit. [22:41:13.412] #0 0x00007ff8c061afc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.440] [Current thread is 1 (LWP 27242)] [22:41:13.561] [22:41:13.561] Thread 2 (Thread 0x7ff8bdfb1a40 (LWP 26178)): [22:41:13.561] #0 0x00007ff8c06dda61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.561] No symbol table info available. [22:41:13.561] #1 0x00007ff8c06cbe5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.561] No symbol table info available. [22:41:13.561] #2 0x00007ff8c06cc497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.561] No symbol table info available. [22:41:13.561] #3 0x00007ff8c06cbcdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.561] No symbol table info available. [22:41:13.561] #4 0x00007ff8c0627a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.561] No symbol table info available. [22:41:13.561] #5 0x00005556c4bbbf06 in RestoreArchivedFile (path=path@entry=0x7ffe2f9aeb40 "\340\356\232/\376\177", xlogfname=xlogfname@entry=0x7ffe2f9aef90 "00000001", '0' , "5", recovername=recovername@entry=0x5556c56bef5c "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [22:41:13.561] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "pg_wal/000000015", '0' , '\000' , "\b\000\000\000\000\000\000\000\204\267k\305VU\000\000h\352\232/\376\177\000\000x\267k\305VU\000\000\350OQ\305VU\000\000\220\357\232/\376\177\000\000\027\357k\305VU\000\000h\352\232/\376\177\000\000\025\357k\305VU\000\000\030\031\373\275\370\177\000\000DZQ\305VU", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [22:41:13.561] xlogRestoreCmd = 0x5556c7076678 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000001", '0' , "5\" \"pg_wal/RECOVERYXLOG\"" [22:41:13.561] lastRestartPointFname = "00000001", '0' , "2\000ZQ\305VU", '\000' , "\001\000\000\034j\000\000\300&{\300\370\177\000\000`'{\300\370\177\000\000\034j\000\000\002", '\000' , "\020}b\300\370\177\000\000\060\343\232/\376\177", '\000' , "Wqw\300\370\177\000\000Oqw\300\370\177\000\000xf\a\307VU", '\000' , "@", '\000' ... [22:41:13.561] rc = [22:41:13.561] stat_buf = {st_dev = 93831165977036, st_ino = 335544320, st_nlink = 140706356243808, st_mode = 0, st_uid = 0, st_gid = 1003, __pad0 = 0, st_rdev = 16296175640461760256, st_size = 16777216, st_blksize = 93831194699384, st_blocks = 140729697101104, st_atim = {tv_sec = 140729697100688, tv_nsec = 140729697100816}, st_mtim = {tv_sec = 0, tv_nsec = 93831194699384}, st_ctim = {tv_sec = 140706356970647, tv_nsec = 0}, __glibc_reserved = {93831165988840, 140729697103776, 93831167719121}} [22:41:13.561] restartSegNo = [22:41:13.561] restartRedoPtr = 33563696 [22:41:13.561] restartTli = 1 [22:41:13.561] __func__ = "RestoreArchivedFile" [22:41:13.561] #6 0x00005556c4bcab96 in XLogFileRead (segno=140729697103680, segno@entry=5, emode=emode@entry=13, tli=tli@entry=1, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4220 [22:41:13.561] xlogfname = "00000001", '0' , "5\000history\000\363\232/\376\177\000\000\212\326\366\301\370\177\000\000\350\262\t\306\002\000\000\000\362\001\000\000\000\000\000" [22:41:13.561] activitymsg = "waiting for 00000001", '0' , "5\000\177\000\000\350OQ\305VU\000\000\260@w\305VU\000\000\255@w\305VU\000\000\250\362\232/\376\177\000\000\253@w\305VU\000" [22:41:13.561] path = "\340\356\232/\376\177\000\000\340\356\232/\000\000\000\000\001\000\000\000\000\000\000\000\244NQ\305VU\000\000pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\274TQ\305VU\000\062", '\000' , "\b\000\000\000\000\000\000\000Y\\k\305VU\000\000\310\356\232/\376\177\000\000U\\k\305VU\000\000\350OQ\305VU\000\000a\\k\305VU\000\000Y\\k\305VU\000\000\310\356\232/\376\177\000\000U\\k\305VU\000\000\030\031\373\275\370\177\000\000\206YQ\305VU", '\000' ... [22:41:13.561] fd = [22:41:13.561] __func__ = "XLogFileRead" [22:41:13.561] #7 0x00005556c4bcad86 in XLogFileReadAnyTLI (segno=5, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4348 [22:41:13.561] hent = [22:41:13.561] tli = 1 [22:41:13.561] cell__state = {l = , i = } [22:41:13.561] path = "\227\336k\305VU\000\000\030\031\373\275\370\177\000\000\320\362\232/\376\177\000\000(bQ\305VU\000\000\000\000\000\000\000\000\000\000\342\"\v\306VU\000\000`#\v\306VU\000\000\224\361\232/\376\177\000\000\330?w\305VU\000\000\361\"\v\306VU\000\000`#\v\306VU\000\000\264\361\232/\376\177\000\000\347?w\305VU\000\000`#\v\306VU\000\000\002\000\000\000\000\000\000\000\345iQ\305VU\000\000\266\361\232/\376\177\000\000\264\361\232/\376\177", '\000' , "\030\000\000\000\060\000\000\000\220\361\232/\376\177\000\000\276jQ\305VU\000\000LC_MESSA"... [22:41:13.561] cell = [22:41:13.561] fd = [22:41:13.561] tles = 0x5556c7088e28 [22:41:13.561] __func__ = "XLogFileReadAnyTLI" [22:41:13.561] #8 0x00005556c4bcbf82 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3781 [22:41:13.561] oldSource = [22:41:13.561] startWalReceiver = false [22:41:13.561] last_fail_time = 765671845222501 [22:41:13.561] now = [22:41:13.561] streaming_reply_sent = false [22:41:13.561] __func__ = "WaitForWALToBecomeAvailable" [22:41:13.561] #9 0x00005556c4bccab7 in XLogPageRead (xlogreader=0x5556c7023fd0, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x5556c7072e48 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3362 [22:41:13.561] private = 0x5556c7023fb0 [22:41:13.561] emode = 15 [22:41:13.561] targetPageOff = 0 [22:41:13.561] targetSegNo = 5 [22:41:13.561] r = [22:41:13.561] __func__ = "XLogPageRead" [22:41:13.561] #10 0x00005556c4bd504b in ReadPageInternal (state=state@entry=0x5556c7023fd0, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [22:41:13.561] readLen = [22:41:13.561] targetPageOff = 0 [22:41:13.561] targetSegNo = 5 [22:41:13.561] hdr = [22:41:13.561] #11 0x00005556c4bd6ca6 in XLogDecodeNextRecord (state=state@entry=0x5556c7023fd0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [22:41:13.561] RecPtr = 83886080 [22:41:13.561] record = [22:41:13.561] targetPagePtr = 83886080 [22:41:13.561] randAccess = false [22:41:13.561] len = [22:41:13.561] total_len = [22:41:13.561] targetRecOff = 0 [22:41:13.561] pageHeaderSize = [22:41:13.561] assembled = false [22:41:13.561] gotheader = [22:41:13.561] readOff = [22:41:13.561] decoded = 0x0 [22:41:13.561] errormsg = 0x5556c7023fd0 "Rȼ\304VU" [22:41:13.561] #12 0x00005556c4bd7848 in XLogReadAhead (state=0x5556c7023fd0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [22:41:13.561] result = [22:41:13.561] #13 0x00005556c4bc2051 in XLogPrefetcherNextBlock (pgsr_private=93831194365440, lsn=0x5556c70887f8) at ../src/backend/access/transam/xlogprefetcher.c:492 [22:41:13.561] nonblocking = [22:41:13.561] record = [22:41:13.561] prefetcher = 0x5556c7024e00 [22:41:13.561] reader = 0x5556c7023fd0 [22:41:13.561] replaying_lsn = 67109152 [22:41:13.561] __func__ = "XLogPrefetcherNextBlock" [22:41:13.561] #14 0x00005556c4bc641a in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [22:41:13.561] No locals. [22:41:13.561] #15 lrq_complete_lsn (lsn=83886080, lrq=0x5556c70886f8) at ../src/backend/access/transam/xlogprefetcher.c:290 [22:41:13.561] No locals. [22:41:13.561] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5556c7024e00, errmsg=errmsg@entry=0x7ffe2f9b3728) at ../src/backend/access/transam/xlogprefetcher.c:1037 [22:41:13.561] record = [22:41:13.561] replayed_up_to = 83886080 [22:41:13.561] #17 0x00005556c4bcd2e4 in ReadRecord (xlogprefetcher=0x5556c7024e00, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3162 [22:41:13.561] errormsg = 0x5556c50c55a4 "AUATUSH\203\354\bH\205\377\017\204:\001" [22:41:13.561] record = [22:41:13.561] xlogreader = 0x5556c7023fd0 [22:41:13.561] private = [22:41:13.561] __func__ = "ReadRecord" [22:41:13.561] #18 0x00005556c4bd0508 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1843 [22:41:13.582] xtime = [22:41:13.582] ru0 = {tv = {tv_sec = 1712356641, tv_usec = 682216}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1261}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15908, __ru_maxrss_word = 15908}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 397, __ru_minflt_word = 397}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 2, __ru_nivcsw_word = 2}}} [22:41:13.582] record = 0x7ff8bd86b1f0 [22:41:13.582] reachedRecoveryTarget = false [22:41:13.582] replayTLI = 1 [22:41:13.582] __func__ = "PerformWalRecovery" [22:41:13.582] #19 0x00005556c4bb9f5d in StartupXLOG () at ../src/backend/access/transam/xlog.c:5770 [22:41:13.582] Insert = [22:41:13.582] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 740}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 731, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1712356640, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 740} [22:41:13.582] wasShutdown = false [22:41:13.582] didCrash = [22:41:13.582] haveTblspcMap = false [22:41:13.582] haveBackupLabel = false [22:41:13.582] EndOfLog = [22:41:13.582] EndOfLogTLI = [22:41:13.582] newTLI = [22:41:13.582] performedWalRecovery = [22:41:13.582] endOfRecoveryInfo = [22:41:13.582] abortedRecPtr = [22:41:13.582] missingContrecPtr = [22:41:13.582] oldestActiveXID = [22:41:13.582] promoted = false [22:41:13.582] __func__ = "StartupXLOG" [22:41:13.582] #20 0x00005556c5077620 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [22:41:13.582] No locals. [22:41:13.582] #21 0x00005556c506ec37 in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [22:41:13.582] pid = [22:41:13.582] #22 0x00005556c5070cb5 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [22:41:13.582] pid = [22:41:13.582] __func__ = "StartChildProcess" [22:41:13.582] #23 0x00005556c5076d7f in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5556c7022ea0) at ../src/backend/postmaster/postmaster.c:1364 [22:41:13.582] opt = [22:41:13.582] status = [22:41:13.582] userDoption = [22:41:13.582] listen_addr_saved = false [22:41:13.582] output_config_variable = [22:41:13.582] __func__ = "PostmasterMain" [22:41:13.582] #24 0x00005556c4e9c818 in main (argc=4, argv=0x5556c7022ea0) at ../src/backend/main/main.c:197 [22:41:13.582] do_check_root = [22:41:13.582] [22:41:13.582] Thread 1 (LWP 27242): [22:41:13.582] #0 0x00007ff8c061afc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.582] No symbol table info available. [22:41:13.582] #1 0x00007ff8c06cc13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.582] No symbol table info available. [22:41:13.582] #2 0x00007ff8c06dda6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [22:41:13.582] No symbol table info available.