[08:42:27.147] src/tools/ci/cores_backtrace.sh linux /tmp/cores [08:42:28.013] dumping /tmp/cores/postgres-3-27981.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [08:42:29.889] [New LWP 27981] [08:42:29.889] [New LWP 27376] [08:42:29.889] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [08:42:30.658] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [08:42:31.591] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [08:42:32.842] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [08:42:35.231] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [08:42:35.231] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [08:42:37.314] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [08:42:38.545] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [08:42:40.119] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [08:42:41.254] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [08:42:42.059] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [08:42:43.311] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [08:42:44.946] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [08:42:46.448] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [08:42:47.376] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [08:42:48.934] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [08:42:50.508] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [08:42:50.980] [Thread debugging using libthread_db enabled] [08:42:50.980] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [08:42:52.216] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [08:42:53.607] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [08:42:54.674] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [08:42:55.296] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [08:42:56.072] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [08:42:58.382] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [08:42:59.314] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [08:43:00.144] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [08:43:01.524] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [08:43:02.501] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [08:43:04.209] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [08:43:05.290] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [08:43:06.103] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [08:43:07.563] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [08:43:08.185] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [08:43:09.739] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [08:43:10.509] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [08:43:11.737] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [08:43:12.545] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [08:43:13.683] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [08:43:14.662] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [08:43:15.959] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [08:43:16.623] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [08:43:17.594] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [08:43:18.390] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [08:43:18.889] Core was generated by `postgres: cascading_standby: startup waiting for 000000020000000000000006 '. [08:43:18.889] Program terminated with signal SIGQUIT, Quit. [08:43:18.889] #0 0x00007f8918d89fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:18.919] [Current thread is 1 (LWP 27981)] [08:43:19.066] [08:43:19.066] Thread 2 (Thread 0x7f8916720a40 (LWP 27376)): [08:43:19.066] #0 0x00007f8918e4ca61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.066] No symbol table info available. [08:43:19.066] #1 0x00007f8918e3ae5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.066] No symbol table info available. [08:43:19.066] #2 0x00007f8918e3b497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.066] No symbol table info available. [08:43:19.066] #3 0x00007f8918e3acdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.066] No symbol table info available. [08:43:19.066] #4 0x00007f8918d96a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.066] No symbol table info available. [08:43:19.066] #5 0x00005623d4148a63 in RestoreArchivedFile (path=path@entry=0x7ffcf561af20 "pg_wal/00000", xlogfname=xlogfname@entry=0x7ffcf561b370 "00000002", '0' , "6", recovername=recovername@entry=0x5623d4c33cbc "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [08:43:19.066] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "\066pg_wal/RECOV\000\000\000\000ISTORY\000\000\b\000\000\000\000\000\000\000\234\004\303\324#V\000\000H\256a\365\374\177\000\000\220\004\303\324#V\000\000\364.\251\324#V\000\000p\263a\365\374\177\000\000w<\303\324#V\000\000H\256a\365\374\177\000\000u<\303\324#V\000\000\030\tr\026\211\177\000\000P9\251\324#V\000\000!\252\302\324\000\000\000\000\000\000\000\000\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [08:43:19.066] xlogRestoreCmd = 0x5623d71cf708 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/035_standby_logical_decoding/data/t_035_standby_logical_decoding_standby_data/archives/00000002", '0' , "6\" \"pg_wal/RECOVERYXLOG\"" [08:43:19.066] lastRestartPointFname = "00000001", '0' , "6\000\071\251\324#V\000\000\360\250a\365\000\000\000\000\000\001\000\000\353l\000\000\300\026\362\030\211\177\000\000`\027\362\030\211\177\000\000\353l\000\000\002", '\000' , "\020m\331\030\211\177\000\000\020\247a\365\374\177\000\000\000\000\000\000\377\377\377\377\000\000\000\000\000\000\000\000Wa\356\030\211\177\000\000Oa\356\030\211\177\000\000\b\367\034\327#V", '\000' , "@\000\000\000\000\000\200\255a\365\374\177", '\000' ... [08:43:19.066] rc = [08:43:19.066] stat_buf = {st_dev = 94711891689688, st_ino = 335544320, st_nlink = 140226804096352, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 14551096102958420992, st_size = 140226805529017, st_blksize = 94711932843784, st_blocks = 140724425304336, st_atim = {tv_sec = 140724425303920, tv_nsec = 140724425304048}, st_mtim = {tv_sec = 0, tv_nsec = 94711932843784}, st_ctim = {tv_sec = 140226804823191, tv_nsec = 0}, __glibc_reserved = {94711891701492, 140724425307008, 94711893394409}} [08:43:19.066] restartSegNo = [08:43:19.066] restartRedoPtr = 100664744 [08:43:19.066] restartTli = 1 [08:43:19.066] __func__ = "RestoreArchivedFile" [08:43:19.066] #6 0x00005623d41576f3 in XLogFileRead (segno=140724425306912, segno@entry=6, emode=emode@entry=13, tli=tli@entry=2, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4209 [08:43:19.066] xlogfname = "00000002", '0' , "6\000history", '\000' , "\002\000\000\000\000\000\000\000\000\000\000" [08:43:19.066] activitymsg = "waiting for 00000002", '0' , "6\000\177\000\000\364.\251\324#V\000\000\320}\316\324#V\000\000\315}\316\324#V\000\000\210\266a\365\374\177\000\000\313}\316\324#V\000" [08:43:19.066] path = "pg_wal/00000\000\000\000\000", '\060' , "\066\000pg_wal/RECOVERYHISTORY\000\000\002\000\000\000\000\000\000\066\000\000\000\000\001\000\000\000\000\000\000\000\000\000\000\063\061\t0/6446\b\000\000\000\000\000\000\000\234\004\303\324#V\000\000\b\000\000\000\000\000\000\000\031\252\302\324#V\000\000\250\262a\365\374\177\000\000\025\252\302\324#V\000\000\364.\251\324#V\000\000!\252\302\324#V\000\000\031\252\302\324#V\000\000\250\262a\365\374\177\000\000\025\252\302\324#V\000\000\030\tr\026\211\177\000\000\222\070\251\324#V", '\000' ... [08:43:19.066] fd = [08:43:19.066] __func__ = "XLogFileRead" [08:43:19.066] #7 0x00005623d41578e3 in XLogFileReadAnyTLI (segno=6, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4337 [08:43:19.066] hent = [08:43:19.066] tli = 2 [08:43:19.066] cell__state = {l = , i = } [08:43:19.066] path = "\367+\303\324#V\000\000\030\tr\026\211\177\000\000\260\266a\365\374\177\000\000\064A\251\324#V\000\000\000\000\000\000\000\000\000\000\002\fa\325#V\000\000\200\fa\325#V\000\000t\265a\365\374\177\000\000\370|\316\324#V\000\000\021\fa\325#V\000\000\200\fa\325#V\000\000\224\265a\365\374\177\000\000\a}\316\324#V\000\000\200\fa\325#V\000\000\002\000\000\000\000\000\000\000\361H\251\324#V\000\000\226\265a\365\374\177\000\000\224\265a\365\374\177", '\000' , "V\000\000\030\000\000\000\060\000\000\000p\265a\365\374\177\000\000\312I\251\324#V\000\000\002\000\000\000\000\000\000\000"... [08:43:19.066] cell = [08:43:19.066] fd = [08:43:19.066] tles = 0x5623d71cfe38 [08:43:19.066] __func__ = "XLogFileReadAnyTLI" [08:43:19.066] #8 0x00005623d4158adf in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=105157064, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=105157040, replayTLI=2, replayLSN=105157040, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3770 [08:43:19.066] oldSource = [08:43:19.066] startWalReceiver = false [08:43:19.066] last_fail_time = 764757597794419 [08:43:19.066] now = [08:43:19.066] streaming_reply_sent = true [08:43:19.066] __func__ = "WaitForWALToBecomeAvailable" [08:43:19.066] #9 0x00005623d4159614 in XLogPageRead (xlogreader=0x5623d717d000, targetPagePtr=105152512, reqLen=4552, targetRecPtr=105157040, readBuf=0x5623d71cbed8 "\025\321\006") at ../src/backend/access/transam/xlogrecovery.c:3351 [08:43:19.066] private = 0x5623d717cfe0 [08:43:19.066] emode = 15 [08:43:19.066] targetPageOff = 4489216 [08:43:19.066] targetSegNo = 6 [08:43:19.066] r = [08:43:19.066] __func__ = "XLogPageRead" [08:43:19.066] #10 0x00005623d4161a6f in ReadPageInternal (state=state@entry=0x5623d717d000, pageptr=pageptr@entry=105152512, reqLen=reqLen@entry=4552) at ../src/backend/access/transam/xlogreader.c:1060 [08:43:19.066] readLen = [08:43:19.066] targetPageOff = 4489216 [08:43:19.066] targetSegNo = 6 [08:43:19.066] hdr = [08:43:19.066] #11 0x00005623d41636ca in XLogDecodeNextRecord (state=state@entry=0x5623d717d000, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [08:43:19.066] RecPtr = 105157040 [08:43:19.066] record = [08:43:19.066] targetPagePtr = 105152512 [08:43:19.066] randAccess = false [08:43:19.066] len = [08:43:19.066] total_len = [08:43:19.066] targetRecOff = 4528 [08:43:19.066] pageHeaderSize = [08:43:19.066] assembled = false [08:43:19.066] gotheader = [08:43:19.066] readOff = [08:43:19.066] decoded = 0x0 [08:43:19.066] errormsg = 0x5623d4cd6101 "LOG" [08:43:19.066] #12 0x00005623d416426c in XLogReadAhead (state=0x5623d717d000, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [08:43:19.066] result = [08:43:19.066] #13 0x00005623d414ebae in XLogPrefetcherNextBlock (pgsr_private=94711932509744, lsn=0x5623d71e1808) at ../src/backend/access/transam/xlogprefetcher.c:492 [08:43:19.066] nonblocking = [08:43:19.066] record = [08:43:19.066] prefetcher = 0x5623d717de30 [08:43:19.066] reader = 0x5623d717d000 [08:43:19.066] replaying_lsn = 105156992 [08:43:19.066] __func__ = "XLogPrefetcherNextBlock" [08:43:19.066] #14 0x00005623d4152f77 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [08:43:19.066] No locals. [08:43:19.066] #15 lrq_complete_lsn (lsn=0, lrq=0x5623d71e1788) at ../src/backend/access/transam/xlogprefetcher.c:290 [08:43:19.066] No locals. [08:43:19.066] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5623d717de30, errmsg=errmsg@entry=0x7ffcf561fb08) at ../src/backend/access/transam/xlogprefetcher.c:1037 [08:43:19.066] record = [08:43:19.066] replayed_up_to = 0 [08:43:19.066] #17 0x00005623d4159e41 in ReadRecord (xlogprefetcher=0x5623d717de30, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=2) at ../src/backend/access/transam/xlogrecovery.c:3151 [08:43:19.066] errormsg = 0x5623d717d810 "" [08:43:19.087] record = [08:43:19.087] xlogreader = 0x5623d717d000 [08:43:19.087] private = [08:43:19.087] __func__ = "ReadRecord" [08:43:19.087] #18 0x00005623d415cfd8 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [08:43:19.087] xtime = [08:43:19.087] ru0 = {tv = {tv_sec = 1711442395, tv_usec = 385664}, ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 1733}, {ru_maxrss = 16032, __ru_maxrss_word = 16032}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 399, __ru_minflt_word = 399}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 2, __ru_nivcsw_word = 2}}} [08:43:19.087] record = 0x7f89160213b8 [08:43:19.087] reachedRecoveryTarget = false [08:43:19.087] replayTLI = 2 [08:43:19.087] __func__ = "PerformWalRecovery" [08:43:19.087] #19 0x00005623d4146c85 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [08:43:19.087] Insert = [08:43:19.087] checkPoint = {redo = 100664744, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 770}, nextOid = 16428, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1711442393, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 769} [08:43:19.087] wasShutdown = false [08:43:19.087] didCrash = [08:43:19.087] haveTblspcMap = false [08:43:19.087] haveBackupLabel = true [08:43:19.087] EndOfLog = [08:43:19.087] EndOfLogTLI = [08:43:19.087] newTLI = [08:43:19.087] performedWalRecovery = [08:43:19.087] endOfRecoveryInfo = [08:43:19.087] abortedRecPtr = [08:43:19.087] missingContrecPtr = [08:43:19.087] oldestActiveXID = [08:43:19.087] promoted = false [08:43:19.087] __func__ = "StartupXLOG" [08:43:19.087] #20 0x00005623d45fe8ca in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [08:43:19.087] No locals. [08:43:19.087] #21 0x00005623d45f6094 in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [08:43:19.087] pid = [08:43:19.087] #22 0x00005623d45f7f5f in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [08:43:19.087] pid = [08:43:19.087] __func__ = "StartChildProcess" [08:43:19.087] #23 0x00005623d45fe029 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5623d717be80) at ../src/backend/postmaster/postmaster.c:1364 [08:43:19.087] opt = [08:43:19.087] status = [08:43:19.087] userDoption = [08:43:19.087] listen_addr_saved = false [08:43:19.087] output_config_variable = [08:43:19.087] __func__ = "PostmasterMain" [08:43:19.087] #24 0x00005623d4426bf9 in main (argc=4, argv=0x5623d717be80) at ../src/backend/main/main.c:197 [08:43:19.087] do_check_root = [08:43:19.087] [08:43:19.087] Thread 1 (LWP 27981): [08:43:19.087] #0 0x00007f8918d89fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.087] No symbol table info available. [08:43:19.087] #1 0x00007f8918e3b13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.087] No symbol table info available. [08:43:19.087] #2 0x00007f8918e4ca6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [08:43:19.087] No symbol table info available.