[13:41:33.559] src/tools/ci/cores_backtrace.sh linux /tmp/cores [13:41:34.246] dumping /tmp/cores/postgres-3-32022.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [13:41:35.915] [New LWP 32022] [13:41:35.915] [New LWP 31417] [13:41:35.915] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [13:41:36.678] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [13:41:37.438] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [13:41:38.657] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [13:41:41.019] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [13:41:41.019] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [13:41:42.892] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [13:41:44.098] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [13:41:45.669] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [13:41:46.730] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [13:41:47.497] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [13:41:48.725] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [13:41:50.334] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [13:41:51.742] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [13:41:52.650] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [13:41:54.181] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [13:41:55.559] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [13:41:56.028] [Thread debugging using libthread_db enabled] [13:41:56.028] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [13:41:57.088] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [13:41:58.481] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [13:41:59.544] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [13:42:00.160] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [13:42:00.925] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [13:42:03.198] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [13:42:04.119] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [13:42:04.880] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [13:42:05.791] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [13:42:06.706] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [13:42:08.289] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [13:42:09.348] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [13:42:10.114] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [13:42:11.497] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [13:42:12.112] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [13:42:13.640] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [13:42:14.398] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [13:42:15.627] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [13:42:16.394] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [13:42:17.461] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [13:42:18.378] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [13:42:19.597] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [13:42:20.211] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [13:42:21.126] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [13:42:21.890] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [13:42:22.400] Core was generated by `postgres: cascading_standby: startup recovering 000000020000000000000006 '. [13:42:22.400] Program terminated with signal SIGQUIT, Quit. [13:42:22.400] #0 0x00007f07ef535fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.430] [Current thread is 1 (LWP 32022)] [13:42:22.543] [13:42:22.543] Thread 2 (Thread 0x7f07ececca40 (LWP 31417)): [13:42:22.543] #0 0x00007f07ef5f8a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.543] No symbol table info available. [13:42:22.543] #1 0x00007f07ef5e6e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.543] No symbol table info available. [13:42:22.543] #2 0x00007f07ef5e7497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.543] No symbol table info available. [13:42:22.543] #3 0x00007f07ef5e6cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.543] No symbol table info available. [13:42:22.543] #4 0x00007f07ef542a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.543] No symbol table info available. [13:42:22.543] #5 0x0000560eed4a230a in RestoreArchivedFile (path=path@entry=0x7ffe9f802080 "", xlogfname=xlogfname@entry=0x7ffe9f802040 "00000003.history", recovername=recovername@entry=0x560eedf8cc90 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [13:42:22.543] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\002\000\000\000\000\000\000\066\000\000\000\000\001\000\000\000\000\000\000\000\000\000\000\063\061\t0/6446\b\000\000\000\000\000\000\000\\\224\370\355\016V\000\000\b\000\000\000\000\000\000\000\331\071\370\355\016V\000\000h\037\200\237\376\177\000\000\325\071\370\355\016V\000\000I\303\336\355\016V\000\000\341\071\370\355\016V\000\000\331\071\370\355\016V\000\000h\037\200\237\376\177\000\000\325\071\370\355\016V\000\000\030\311\354\354\a\177\000\000\347\314\336\355\016V", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [13:42:22.543] xlogRestoreCmd = 0x560eeff995b8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/035_standby_logical_decoding/data/t_035_standby_logical_decoding_standby_data/archives/00000003.history\" \"pg_wal/RECOVERYHISTORY\"" [13:42:22.543] lastRestartPointFname = '0' , "\000\314\370\355\016V\000\000\b\033\200\237\376\177\000\000C\314\370\355\016V\000\000\030\311\354\354\a\177\000\000\245\315\336\355\016V\000\000\341\071\370\355\000\000\000\000\000\000\000\000\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000\016", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [13:42:22.543] rc = [13:42:22.543] stat_buf = {st_dev = 4294967295, st_ino = 206158430209, st_nlink = 140731574393584, st_mode = 8, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 94622120331293, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 0}, st_mtim = {tv_sec = 3891110078048108544, tv_nsec = 5922071200885860208}, st_ctim = {tv_sec = 1448035141, tv_nsec = 98210053116745}, __glibc_reserved = {8, 94622122021980, 140731574393608}} [13:42:22.543] restartSegNo = [13:42:22.543] restartRedoPtr = 94622120331293 [13:42:22.543] restartTli = 0 [13:42:22.543] __func__ = "RestoreArchivedFile" [13:42:22.543] #6 0x0000560eed478718 in existsTimeLineHistory (probeTLI=probeTLI@entry=3) at ../src/backend/access/transam/timeline.c:235 [13:42:22.543] path = '\000' , "\002\000\000\000\000\000\000\000\t\022K\355\016V\000\000\274\273\370\355\016V\000\000\006\000\000\000\r\000\000\000\267\273\370\355\016V\000\000\030\311\354\354\a\177\000\000p#\200\237\376\177\000\000\211\325\336\355\016V\000\000\000\000\000\000\000\000\000\000\302\225\226\356\016V\000\000@\226\226\356\016V\000\000\064\"\200\237\376\177\000\000\370\f\004\356\016V\000\000ѕ\226\356\016V\000\000@\226\226\356\016V\000\000T\"\200\237\376\177\000\000\a\r\004\356\016V\000\000@\226\226\356\016V\000\000\002\000\000\000\000\000\000\000F\335\336\355\016V\000\000V\"\200\237\376\177\000\000T\"\200\237\376\177", '\000' ... [13:42:22.543] histfname = "00000003.history", '\000' [13:42:22.543] fd = [13:42:22.543] __func__ = "existsTimeLineHistory" [13:42:22.543] #7 0x0000560eed478803 in findNewestTimeLine (startTLI=startTLI@entry=2) at ../src/backend/access/transam/timeline.c:277 [13:42:22.543] newestTLI = 2 [13:42:22.543] probeTLI = 3 [13:42:22.543] #8 0x0000560eed4ad2d5 in rescanLatestTimeLine (replayTLI=replayTLI@entry=2, replayLSN=replayLSN@entry=105157040) at ../src/backend/access/transam/xlogrecovery.c:4113 [13:42:22.543] newExpectedTLEs = [13:42:22.543] found = [13:42:22.543] cell = [13:42:22.543] newtarget = [13:42:22.543] oldtarget = 2 [13:42:22.543] currentTle = 0x0 [13:42:22.543] __func__ = "rescanLatestTimeLine" [13:42:22.543] #9 0x0000560eed4b2485 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=105157064, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=105157040, replayTLI=2, replayLSN=105157040, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [13:42:22.543] oldSource = XLOG_FROM_STREAM [13:42:22.543] startWalReceiver = false [13:42:22.543] last_fail_time = 764689152538679 [13:42:22.543] now = [13:42:22.543] streaming_reply_sent = true [13:42:22.543] __func__ = "WaitForWALToBecomeAvailable" [13:42:22.543] #10 0x0000560eed4b2ebb in XLogPageRead (xlogreader=0x560eeff46ed0, targetPagePtr=105152512, reqLen=4552, targetRecPtr=105157040, readBuf=0x560eeff95d88 "\025\321\006") at ../src/backend/access/transam/xlogrecovery.c:3351 [13:42:22.543] private = 0x560eeff46eb0 [13:42:22.543] emode = 15 [13:42:22.543] targetPageOff = 4489216 [13:42:22.543] targetSegNo = 6 [13:42:22.543] r = [13:42:22.543] __func__ = "XLogPageRead" [13:42:22.543] #11 0x0000560eed4bb316 in ReadPageInternal (state=state@entry=0x560eeff46ed0, pageptr=pageptr@entry=105152512, reqLen=reqLen@entry=4552) at ../src/backend/access/transam/xlogreader.c:1060 [13:42:22.543] readLen = [13:42:22.543] targetPageOff = 4489216 [13:42:22.543] targetSegNo = 6 [13:42:22.543] hdr = [13:42:22.543] #12 0x0000560eed4bcf71 in XLogDecodeNextRecord (state=state@entry=0x560eeff46ed0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [13:42:22.543] RecPtr = 105157040 [13:42:22.543] record = [13:42:22.543] targetPagePtr = 105152512 [13:42:22.543] randAccess = false [13:42:22.543] len = [13:42:22.543] total_len = [13:42:22.543] targetRecOff = 4528 [13:42:22.543] pageHeaderSize = [13:42:22.543] assembled = false [13:42:22.543] gotheader = [13:42:22.543] readOff = [13:42:22.543] decoded = 0x0 [13:42:22.543] errormsg = 0x560eee02f101 "LOG" [13:42:22.543] #13 0x0000560eed4bdb13 in XLogReadAhead (state=0x560eeff46ed0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [13:42:22.543] result = [13:42:22.543] #14 0x0000560eed4a8455 in XLogPrefetcherNextBlock (pgsr_private=94622155308288, lsn=0x560eeffab6b8) at ../src/backend/access/transam/xlogprefetcher.c:492 [13:42:22.543] nonblocking = [13:42:22.543] record = [13:42:22.543] prefetcher = 0x560eeff47d00 [13:42:22.543] reader = 0x560eeff46ed0 [13:42:22.543] replaying_lsn = 105156920 [13:42:22.543] __func__ = "XLogPrefetcherNextBlock" [13:42:22.543] #15 0x0000560eed4ac81e in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [13:42:22.543] No locals. [13:42:22.543] #16 lrq_complete_lsn (lsn=0, lrq=0x560eeffab638) at ../src/backend/access/transam/xlogprefetcher.c:290 [13:42:22.543] No locals. [13:42:22.543] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x560eeff47d00, errmsg=errmsg@entry=0x7ffe9f8067c8) at ../src/backend/access/transam/xlogprefetcher.c:1037 [13:42:22.543] record = [13:42:22.543] replayed_up_to = 0 [13:42:22.543] #18 0x0000560eed4b36e8 in ReadRecord (xlogprefetcher=0x560eeff47d00, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=2) at ../src/backend/access/transam/xlogrecovery.c:3151 [13:42:22.543] errormsg = 0x560eeff476e0 "" [13:42:22.543] record = [13:42:22.543] xlogreader = 0x560eeff46ed0 [13:42:22.543] private = [13:42:22.543] __func__ = "ReadRecord" [13:42:22.543] #19 0x0000560eed4b687f in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [13:42:22.543] xtime = [13:42:22.543] ru0 = {tv = {tv_sec = 1711373950, tv_usec = 25971}, ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 1734}, {ru_maxrss = 15964, __ru_maxrss_word = 15964}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 402, __ru_minflt_word = 402}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [13:42:22.562] record = 0x7f07ec7cb070 [13:42:22.562] reachedRecoveryTarget = false [13:42:22.562] replayTLI = 2 [13:42:22.562] __func__ = "PerformWalRecovery" [13:42:22.562] #20 0x0000560eed4a052c in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [13:42:22.562] Insert = [13:42:22.562] checkPoint = {redo = 100664744, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 770}, nextOid = 16428, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1711373948, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 769} [13:42:22.562] wasShutdown = false [13:42:22.562] didCrash = [13:42:22.562] haveTblspcMap = false [13:42:22.562] haveBackupLabel = true [13:42:22.562] EndOfLog = [13:42:22.562] EndOfLogTLI = [13:42:22.562] newTLI = [13:42:22.562] performedWalRecovery = [13:42:22.562] endOfRecoveryInfo = [13:42:22.562] abortedRecPtr = [13:42:22.562] missingContrecPtr = [13:42:22.562] oldestActiveXID = [13:42:22.562] promoted = false [13:42:22.562] __func__ = "StartupXLOG" [13:42:22.562] #21 0x0000560eed957e5d in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [13:42:22.562] No locals. [13:42:22.562] #22 0x0000560eed94f627 in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [13:42:22.562] pid = [13:42:22.562] #23 0x0000560eed9514f2 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [13:42:22.562] pid = [13:42:22.562] __func__ = "StartChildProcess" [13:42:22.562] #24 0x0000560eed9575bc in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x560eeff45d50) at ../src/backend/postmaster/postmaster.c:1364 [13:42:22.562] opt = [13:42:22.562] status = [13:42:22.562] userDoption = [13:42:22.562] listen_addr_saved = false [13:42:22.562] output_config_variable = [13:42:22.562] __func__ = "PostmasterMain" [13:42:22.562] #25 0x0000560eed780165 in main (argc=4, argv=0x560eeff45d50) at ../src/backend/main/main.c:197 [13:42:22.562] do_check_root = [13:42:22.562] [13:42:22.562] Thread 1 (LWP 32022): [13:42:22.562] #0 0x00007f07ef535fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.562] No symbol table info available. [13:42:22.562] #1 0x00007f07ef5e713a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.562] No symbol table info available. [13:42:22.562] #2 0x00007f07ef5f8a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [13:42:22.562] No symbol table info available.