[00:30:05.483] src/tools/ci/cores_backtrace.sh linux /tmp/cores [00:30:06.321] dumping /tmp/cores/postgres-3-23696.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [00:30:08.218] [New LWP 23696] [00:30:08.218] [New LWP 22605] [00:30:08.218] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [00:30:08.978] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [00:30:09.893] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [00:30:11.110] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [00:30:13.662] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [00:30:13.662] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [00:30:15.737] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [00:30:16.947] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [00:30:18.602] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [00:30:19.712] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [00:30:20.522] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [00:30:21.866] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [00:30:23.592] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [00:30:25.051] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [00:30:25.958] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [00:30:27.495] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [00:30:29.045] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [00:30:29.516] [Thread debugging using libthread_db enabled] [00:30:29.516] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [00:30:30.740] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [00:30:32.166] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [00:30:33.226] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [00:30:33.871] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [00:30:34.731] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [00:30:37.264] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [00:30:38.212] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [00:30:39.041] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [00:30:40.327] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [00:30:41.284] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [00:30:42.982] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [00:30:44.085] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [00:30:44.889] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [00:30:46.325] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [00:30:46.963] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [00:30:48.492] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [00:30:49.256] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [00:30:50.482] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [00:30:51.288] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [00:30:52.406] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [00:30:53.367] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [00:30:54.637] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [00:30:55.273] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [00:30:56.236] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [00:30:57.026] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [00:30:57.519] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [00:30:57.519] Program terminated with signal SIGQUIT, Quit. [00:30:57.519] #0 0x00007fbdaf386fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.548] [Current thread is 1 (LWP 23696)] [00:30:57.680] [00:30:57.680] Thread 2 (Thread 0x7fbdacd1da40 (LWP 22605)): [00:30:57.680] #0 0x00007fbdaf449a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.680] No symbol table info available. [00:30:57.680] #1 0x00007fbdaf437e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.680] No symbol table info available. [00:30:57.680] #2 0x00007fbdaf438497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.680] No symbol table info available. [00:30:57.680] #3 0x00007fbdaf437cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.680] No symbol table info available. [00:30:57.680] #4 0x00007fbdaf393a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.680] No symbol table info available. [00:30:57.680] #5 0x000055d75cdb8e47 in RestoreArchivedFile (path=path@entry=0x7ffc5495b940 "\001", xlogfname=xlogfname@entry=0x7ffc5495b900 "00000002.history", recovername=recovername@entry=0x55d75d8a8df0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [00:30:57.680] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\207rp]\327U\000\062", '\000' , "\b\000\000\000\000\000\000\000y\372\211]\327U\000\000(\270\225T\374\177\000\000u\372\211]\327U\000\000\263mp]\327U\000\000\201\372\211]\327U\000\000y\372\211]\327U\000\000(\270\225T\374\177\000\000u\372\211]\327U\000\000\030\331Ѭ\275\177\000\000Qwp]\327U", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [00:30:57.680] xlogRestoreCmd = 0x55d75f1e7508 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [00:30:57.680] lastRestartPointFname = '0' , "\000\177p]\327U", '\000' , "\200\263\225T\374\177\000\000Qwp]\327U", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [00:30:57.680] rc = [00:30:57.680] stat_buf = {st_dev = 32768, st_ino = 207870274038, st_nlink = 738563608, st_mode = 1711843830, st_uid = 0, st_gid = 610563701, __pad0 = 0, st_rdev = 1711843830, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 3472113003596310384}, st_mtim = {tv_sec = 3832897741394030640, tv_nsec = 3472328296227680304}, st_ctim = {tv_sec = 808464432, tv_nsec = 0}, __glibc_reserved = {8, 94383475676580, 140721727583176}} [00:30:57.680] restartSegNo = [00:30:57.680] restartRedoPtr = 94383473980039 [00:30:57.680] restartTli = 0 [00:30:57.680] __func__ = "RestoreArchivedFile" [00:30:57.680] #6 0x000055d75cd8f0e8 in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [00:30:57.680] path = "\001", '\000' , "\001\000\000\000\000\000\000\000I\177\334\\\327U\000\000\034}\212]\327U\000\000\377\377\377\377\r\000\000\000pg_wal/00000001", '0' , "5\000\000\000\000\000\000\000\000\000b\233(^\327U\000\000\340\233(^\327U\000\000\364\272\225T\374\177\000\000\230ޕ]\327U\000\000q\233(^\327U\000\000\340\233(^\327U\000\000\024\273\225T\374\177\000\000\247ޕ]\327U\000\000\340\233(^\327U\000\000\002\000\000\000\000\000\000\000\260\207p]\327U\000\000\026\273\225T\374\177\000\000\024\273\225T\374\177", '\000' ... [00:30:57.680] histfname = "00000002.history\000\000\000\000\000\000\000\000XE\031_\327U\000\000\005\000\000\000\002\000\000\000\004\000\000\t\000\000\000\000\270\234\037_\327U\000\000\001\000\000\000\000\000\000" [00:30:57.680] fd = [00:30:57.680] __func__ = "existsTimeLineHistory" [00:30:57.680] #7 0x000055d75cd8f1d3 in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [00:30:57.680] newestTLI = 1 [00:30:57.680] probeTLI = 2 [00:30:57.680] #8 0x000055d75cdc3e12 in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=83886080) at ../src/backend/access/transam/xlogrecovery.c:4113 [00:30:57.680] newExpectedTLEs = [00:30:57.680] found = [00:30:57.680] cell = [00:30:57.680] newtarget = [00:30:57.680] oldtarget = 1 [00:30:57.680] currentTle = 0x0 [00:30:57.680] __func__ = "rescanLatestTimeLine" [00:30:57.680] #9 0x000055d75cdc8fc2 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [00:30:57.680] oldSource = XLOG_FROM_STREAM [00:30:57.680] startWalReceiver = false [00:30:57.680] last_fail_time = 765159034824850 [00:30:57.680] now = [00:30:57.680] streaming_reply_sent = false [00:30:57.680] __func__ = "WaitForWALToBecomeAvailable" [00:30:57.680] #10 0x000055d75cdc99f8 in XLogPageRead (xlogreader=0x55d75f194e80, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x55d75f1e3cd8 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [00:30:57.680] private = 0x55d75f194e60 [00:30:57.680] emode = 15 [00:30:57.680] targetPageOff = 0 [00:30:57.680] targetSegNo = 5 [00:30:57.680] r = [00:30:57.680] __func__ = "XLogPageRead" [00:30:57.680] #11 0x000055d75cdd1e53 in ReadPageInternal (state=state@entry=0x55d75f194e80, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [00:30:57.680] readLen = [00:30:57.680] targetPageOff = 0 [00:30:57.680] targetSegNo = 5 [00:30:57.680] hdr = [00:30:57.680] #12 0x000055d75cdd3aae in XLogDecodeNextRecord (state=state@entry=0x55d75f194e80, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [00:30:57.680] RecPtr = 83886080 [00:30:57.680] record = [00:30:57.680] targetPagePtr = 83886080 [00:30:57.680] randAccess = false [00:30:57.680] len = [00:30:57.680] total_len = [00:30:57.680] targetRecOff = 0 [00:30:57.680] pageHeaderSize = [00:30:57.680] assembled = false [00:30:57.680] gotheader = [00:30:57.680] readOff = [00:30:57.680] decoded = 0x0 [00:30:57.680] errormsg = 0x55d75f194e80 "\223\227\334\\\327U" [00:30:57.680] #13 0x000055d75cdd4650 in XLogReadAhead (state=0x55d75f194e80, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [00:30:57.680] result = [00:30:57.680] #14 0x000055d75cdbef92 in XLogPrefetcherNextBlock (pgsr_private=94383501827248, lsn=0x55d75f1f9688) at ../src/backend/access/transam/xlogprefetcher.c:492 [00:30:57.680] nonblocking = [00:30:57.680] record = [00:30:57.680] prefetcher = 0x55d75f195cb0 [00:30:57.680] reader = 0x55d75f194e80 [00:30:57.680] replaying_lsn = 67109152 [00:30:57.680] __func__ = "XLogPrefetcherNextBlock" [00:30:57.680] #15 0x000055d75cdc335b in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [00:30:57.680] No locals. [00:30:57.680] #16 lrq_complete_lsn (lsn=83886080, lrq=0x55d75f1f9588) at ../src/backend/access/transam/xlogprefetcher.c:290 [00:30:57.680] No locals. [00:30:57.680] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x55d75f195cb0, errmsg=errmsg@entry=0x7ffc54960088) at ../src/backend/access/transam/xlogprefetcher.c:1037 [00:30:57.680] record = [00:30:57.680] replayed_up_to = 83886080 [00:30:57.680] #18 0x000055d75cdca225 in ReadRecord (xlogprefetcher=0x55d75f195cb0, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [00:30:57.680] errormsg = 0x55d75d2bf69b "AUATUSH\203\354\bH\205\377\017\204:\001" [00:30:57.680] record = [00:30:57.680] xlogreader = 0x55d75f194e80 [00:30:57.680] private = [00:30:57.680] __func__ = "ReadRecord" [00:30:57.680] #19 0x000055d75cdcd3bc in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [00:30:57.680] xtime = [00:30:57.680] ru0 = {tv = {tv_sec = 1711843830, tv_usec = 742396}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1338}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16048, __ru_maxrss_word = 16048}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 402, __ru_minflt_word = 402}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [00:30:57.680] record = 0x7fbdac5d71f0 [00:30:57.701] reachedRecoveryTarget = false [00:30:57.701] replayTLI = 1 [00:30:57.701] __func__ = "PerformWalRecovery" [00:30:57.701] #20 0x000055d75cdb7069 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [00:30:57.701] Insert = [00:30:57.701] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1711843829, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [00:30:57.701] wasShutdown = false [00:30:57.701] didCrash = [00:30:57.701] haveTblspcMap = false [00:30:57.701] haveBackupLabel = false [00:30:57.701] EndOfLog = [00:30:57.701] EndOfLogTLI = [00:30:57.701] newTLI = [00:30:57.701] performedWalRecovery = [00:30:57.701] endOfRecoveryInfo = [00:30:57.701] abortedRecPtr = [00:30:57.701] missingContrecPtr = [00:30:57.701] oldestActiveXID = [00:30:57.701] promoted = false [00:30:57.701] __func__ = "StartupXLOG" [00:30:57.701] #21 0x000055d75d2713e5 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [00:30:57.701] No locals. [00:30:57.701] #22 0x000055d75d268baf in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [00:30:57.701] pid = [00:30:57.701] #23 0x000055d75d26aa7a in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [00:30:57.701] pid = [00:30:57.701] __func__ = "StartChildProcess" [00:30:57.701] #24 0x000055d75d270b44 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x55d75f193d50) at ../src/backend/postmaster/postmaster.c:1364 [00:30:57.701] opt = [00:30:57.701] status = [00:30:57.701] userDoption = [00:30:57.701] listen_addr_saved = false [00:30:57.701] output_config_variable = [00:30:57.701] __func__ = "PostmasterMain" [00:30:57.701] #25 0x000055d75d098ab8 in main (argc=4, argv=0x55d75f193d50) at ../src/backend/main/main.c:197 [00:30:57.701] do_check_root = [00:30:57.701] [00:30:57.701] Thread 1 (LWP 23696): [00:30:57.701] #0 0x00007fbdaf386fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.701] No symbol table info available. [00:30:57.701] #1 0x00007fbdaf43813a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.701] No symbol table info available. [00:30:57.701] #2 0x00007fbdaf449a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [00:30:57.701] No symbol table info available.