[22:20:48.614] src/tools/ci/cores_backtrace.sh linux /tmp/cores [22:20:49.303] dumping /tmp/cores/postgres-3-34058.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [22:20:51.134] [New LWP 34058] [22:20:51.134] [New LWP 33406] [22:20:51.134] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [22:20:51.895] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [22:20:52.808] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [22:20:54.068] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [22:20:56.643] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [22:20:56.643] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [22:20:58.712] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [22:20:59.924] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [22:21:01.542] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [22:21:02.636] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [22:21:03.430] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [22:21:04.761] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [22:21:06.473] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [22:21:07.936] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [22:21:08.846] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [22:21:10.373] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [22:21:11.905] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [22:21:12.373] [Thread debugging using libthread_db enabled] [22:21:12.373] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [22:21:13.624] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [22:21:15.055] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [22:21:16.114] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [22:21:16.748] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [22:21:17.599] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [22:21:20.108] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [22:21:21.033] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [22:21:21.846] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [22:21:23.150] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [22:21:24.100] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [22:21:25.786] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [22:21:26.879] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [22:21:27.674] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [22:21:29.131] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [22:21:29.761] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [22:21:31.303] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [22:21:32.074] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [22:21:33.324] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [22:21:34.147] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [22:21:35.288] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [22:21:36.261] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [22:21:37.549] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [22:21:38.200] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [22:21:39.172] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [22:21:39.946] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [22:21:40.432] Core was generated by `postgres: cascading_standby: startup waiting for 000000020000000000000006 '. [22:21:40.432] Program terminated with signal SIGQUIT, Quit. [22:21:40.432] #0 0x00007fcffdb81fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.458] [Current thread is 1 (LWP 34058)] [22:21:40.557] [22:21:40.557] Thread 2 (Thread 0x7fcffb518a40 (LWP 33406)): [22:21:40.557] #0 0x00007fcffdc44a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.557] No symbol table info available. [22:21:40.557] #1 0x00007fcffdc32e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.557] No symbol table info available. [22:21:40.557] #2 0x00007fcffdc33497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.557] No symbol table info available. [22:21:40.557] #3 0x00007fcffdc32cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.557] No symbol table info available. [22:21:40.557] #4 0x00007fcffdb8ea69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.557] No symbol table info available. [22:21:40.557] #5 0x000056051544511f in RestoreArchivedFile (path=path@entry=0x7ffce3694e70 "pg_wal/00000", xlogfname=xlogfname@entry=0x7ffce36952c0 "00000002", '0' , "6", recovername=recovername@entry=0x560515f37d7c "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [22:21:40.557] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "\066pg_wal/RECOV\000\000\000\000ISTORY\000\000\b\000\000\000\000\000\000\000DE\363\025\005V\000\000\230Mi\343\374\177\000\000\070E\363\025\005V\000\000Bl\331\025\005V\000\000\300Ri\343\374\177\000\000\067}\363\025\005V\000\000\230Mi\343\374\177\000\000\065}\363\025\005V\000\000\030\211Q\373\317\177\000\000\236v\331\025\005V\000\000\341\351\362\025\000\000\000\000\000\000\000\000\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [22:21:40.557] xlogRestoreCmd = 0x5605176895f8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/035_standby_logical_decoding/data/t_035_standby_logical_decoding_standby_data/archives/00000002", '0' , "6\" \"pg_wal/RECOVERYXLOG\"" [22:21:40.557] lastRestartPointFname = "00000001", '0' , "6\000v\331\025\005V\000\000@Hi\343\000\000\000\000\000\001\000\000Ä\000\000\300\226\321\375\317\177\000\000`\227\321\375\317\177\000\000Ä\000\000\002", '\000' , "\020\355\270\375\317\177\000\000`Fi\343\374\177\000\000\000\000\000\000\377\377\377\377\000\000\000\000\000\000\000\000W\341\315\375\317\177\000\000O\341\315\375\317\177\000\000\370\225h\027\005V", '\000' , "@\000\000\000\000\000\320Li\343\374\177", '\000' , "(\000\000\000"... [22:21:40.557] rc = [22:21:40.557] stat_buf = {st_dev = 94579841383974, st_ino = 335544320, st_nlink = 140531291659616, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 15111155269137854720, st_size = 140531293092281, st_blksize = 94579867555320, st_blocks = 140724123813984, st_atim = {tv_sec = 140724123813568, tv_nsec = 140724123813696}, st_mtim = {tv_sec = 0, tv_nsec = 94579867555320}, st_ctim = {tv_sec = 140531292386455, tv_nsec = 0}, __glibc_reserved = {94579841395778, 140724123816656, 94579843089553}} [22:21:40.557] restartSegNo = [22:21:40.557] restartRedoPtr = 100664744 [22:21:40.557] restartTli = 1 [22:21:40.557] __func__ = "RestoreArchivedFile" [22:21:40.557] #6 0x0000560515453daf in XLogFileRead (segno=140724123816560, segno@entry=6, emode=emode@entry=13, tli=tli@entry=2, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4220 [22:21:40.557] xlogfname = "00000002", '0' , "6\000history", '\000' , "\002\000\000\000\000\000\000\000\000\000\000" [22:21:40.557] activitymsg = "waiting for 00000002", '0' , "6\000\177\000\000Bl\331\025\005V\000\000p\317\376\025\005V\000\000m\317\376\025\005V\000\000\330Ui\343\374\177\000\000k\317\376\025\005V\000" [22:21:40.557] path = "pg_wal/00000\000\000\000\000", '\060' , "\066\000pg_wal/RECOVERYHISTORY\000\000\002\000\000\000\000\000\000\066\000\000\000\000\001\000\000\000\000\000\000\000\000\000\000\063\061\t0/6447\b\000\000\000\000\000\000\000DE\363\025\005V\000\000\b\000\000\000\000\000\000\000\331\351\362\025\005V\000\000\370Qi\343\374\177\000\000\325\351\362\025\005V\000\000Bl\331\025\005V\000\000\341\351\362\025\005V\000\000\331\351\362\025\005V\000\000\370Qi\343\374\177\000\000\325\351\362\025\005V\000\000\030\211Q\373\317\177\000\000\340u\331\025\005V", '\000' ... [22:21:40.557] fd = [22:21:40.557] __func__ = "XLogFileRead" [22:21:40.557] #7 0x0000560515453f9f in XLogFileReadAnyTLI (segno=6, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4348 [22:21:40.557] hent = [22:21:40.557] tli = 2 [22:21:40.557] cell__state = {l = , i = } [22:21:40.557] path = "\267l\363\025\005V\000\000\030\211Q\373\317\177\000\000\000Vi\343\374\177\000\000\202~\331\025\005V\000\000\000\000\000\000\000\000\000\000\202ӑ\026\005V\000\000\000ԑ\026\005V\000\000\304Ti\343\374\177\000\000\230\316\376\025\005V\000\000\221ӑ\026\005V\000\000\000ԑ\026\005V\000\000\344Ti\343\374\177\000\000\247\316\376\025\005V\000\000\000ԑ\026\005V\000\000\002\000\000\000\000\000\000\000?\206\331\025\005V\000\000\346Ti\343\374\177\000\000\344Ti\343\374\177", '\000' , "V\000\000\030\000\000\000\060\000\000\000\300Ti\343\374\177\000\000\030\207\331\025\005V\000\000\002\000\000\000\000\000\000\000\030\000\000\000\060"... [22:21:40.557] cell = [22:21:40.557] fd = [22:21:40.557] tles = 0x560517689d28 [22:21:40.557] __func__ = "XLogFileReadAnyTLI" [22:21:40.557] #8 0x000056051545519b in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=105158840, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=105158816, replayTLI=2, replayLSN=105158816, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3781 [22:21:40.557] oldSource = [22:21:40.557] startWalReceiver = false [22:21:40.557] last_fail_time = 765411332944859 [22:21:40.557] now = [22:21:40.557] streaming_reply_sent = true [22:21:40.557] __func__ = "WaitForWALToBecomeAvailable" [22:21:40.557] #9 0x0000560515455cd0 in XLogPageRead (xlogreader=0x560517636f10, targetPagePtr=105152512, reqLen=6328, targetRecPtr=105158816, readBuf=0x560517685dc8 "\025\321\006") at ../src/backend/access/transam/xlogrecovery.c:3362 [22:21:40.557] private = 0x560517636ef0 [22:21:40.557] emode = 15 [22:21:40.557] targetPageOff = 4489216 [22:21:40.557] targetSegNo = 6 [22:21:40.557] r = [22:21:40.557] __func__ = "XLogPageRead" [22:21:40.557] #10 0x000056051545e264 in ReadPageInternal (state=state@entry=0x560517636f10, pageptr=pageptr@entry=105152512, reqLen=reqLen@entry=6328) at ../src/backend/access/transam/xlogreader.c:1060 [22:21:40.557] readLen = [22:21:40.557] targetPageOff = 4489216 [22:21:40.557] targetSegNo = 6 [22:21:40.557] hdr = [22:21:40.557] #11 0x000056051545febf in XLogDecodeNextRecord (state=state@entry=0x560517636f10, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [22:21:40.557] RecPtr = 105158816 [22:21:40.557] record = [22:21:40.557] targetPagePtr = 105152512 [22:21:40.557] randAccess = false [22:21:40.557] len = [22:21:40.557] total_len = [22:21:40.557] targetRecOff = 6304 [22:21:40.557] pageHeaderSize = [22:21:40.557] assembled = false [22:21:40.557] gotheader = [22:21:40.557] readOff = [22:21:40.557] decoded = 0x0 [22:21:40.557] errormsg = 0x560515fdb241 "LOG" [22:21:40.557] #12 0x0000560515460a61 in XLogReadAhead (state=0x560517636f10, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [22:21:40.557] result = [22:21:40.557] #13 0x000056051544b26a in XLogPrefetcherNextBlock (pgsr_private=94579867221312, lsn=0x56051769b6f8) at ../src/backend/access/transam/xlogprefetcher.c:492 [22:21:40.557] nonblocking = [22:21:40.557] record = [22:21:40.557] prefetcher = 0x560517637d40 [22:21:40.557] reader = 0x560517636f10 [22:21:40.557] replaying_lsn = 105158696 [22:21:40.557] __func__ = "XLogPrefetcherNextBlock" [22:21:40.557] #14 0x000056051544f633 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [22:21:40.557] No locals. [22:21:40.557] #15 lrq_complete_lsn (lsn=0, lrq=0x56051769b678) at ../src/backend/access/transam/xlogprefetcher.c:290 [22:21:40.557] No locals. [22:21:40.557] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x560517637d40, errmsg=errmsg@entry=0x7ffce3699a58) at ../src/backend/access/transam/xlogprefetcher.c:1037 [22:21:40.557] record = [22:21:40.557] replayed_up_to = 0 [22:21:40.557] #17 0x00005605154564fd in ReadRecord (xlogprefetcher=0x560517637d40, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=2) at ../src/backend/access/transam/xlogrecovery.c:3162 [22:21:40.574] errormsg = 0x560517637720 "" [22:21:40.574] record = [22:21:40.574] xlogreader = 0x560517636f10 [22:21:40.574] private = [22:21:40.574] __func__ = "ReadRecord" [22:21:40.574] #18 0x0000560515459721 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1843 [22:21:40.574] xtime = [22:21:40.574] ru0 = {tv = {tv_sec = 1712096130, tv_usec = 672134}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1604}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15924, __ru_maxrss_word = 15924}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 406, __ru_minflt_word = 406}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [22:21:40.574] record = 0x7fcffae19a78 [22:21:40.574] reachedRecoveryTarget = false [22:21:40.574] replayTLI = 2 [22:21:40.574] __func__ = "PerformWalRecovery" [22:21:40.574] #19 0x0000560515443337 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5724 [22:21:40.574] Insert = [22:21:40.574] checkPoint = {redo = 100664744, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 771}, nextOid = 16428, nextMulti = 1, nextMultiOffset = 0, oldestXid = 731, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1712096129, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 770} [22:21:40.574] wasShutdown = false [22:21:40.574] didCrash = [22:21:40.574] haveTblspcMap = false [22:21:40.574] haveBackupLabel = true [22:21:40.574] EndOfLog = [22:21:40.574] EndOfLogTLI = [22:21:40.574] newTLI = [22:21:40.574] performedWalRecovery = [22:21:40.574] endOfRecoveryInfo = [22:21:40.574] abortedRecPtr = [22:21:40.574] missingContrecPtr = [22:21:40.574] oldestActiveXID = [22:21:40.574] promoted = false [22:21:40.574] __func__ = "StartupXLOG" [22:21:40.574] #20 0x00005605158fc5f0 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [22:21:40.574] No locals. [22:21:40.574] #21 0x00005605158f3dba in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [22:21:40.574] pid = [22:21:40.574] #22 0x00005605158f5c85 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [22:21:40.574] pid = [22:21:40.574] __func__ = "StartChildProcess" [22:21:40.574] #23 0x00005605158fbd4f in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x560517635d90) at ../src/backend/postmaster/postmaster.c:1364 [22:21:40.574] opt = [22:21:40.574] status = [22:21:40.574] userDoption = [22:21:40.574] listen_addr_saved = false [22:21:40.574] output_config_variable = [22:21:40.574] __func__ = "PostmasterMain" [22:21:40.574] #24 0x0000560515723cdb in main (argc=4, argv=0x560517635d90) at ../src/backend/main/main.c:197 [22:21:40.574] do_check_root = [22:21:40.574] [22:21:40.574] Thread 1 (LWP 34058): [22:21:40.574] #0 0x00007fcffdb81fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.574] No symbol table info available. [22:21:40.574] #1 0x00007fcffdc3313a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.574] No symbol table info available. [22:21:40.574] #2 0x00007fcffdc44a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [22:21:40.574] No symbol table info available.