[14:06:49.635] src/tools/ci/cores_backtrace.sh linux /tmp/cores [14:06:50.343] dumping /tmp/cores/postgres-3-26402.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [14:06:52.153] [New LWP 26402] [14:06:52.153] [New LWP 25683] [14:06:52.153] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [14:06:52.911] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [14:06:53.803] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [14:06:55.064] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [14:06:57.427] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [14:06:57.427] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [14:06:59.302] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [14:07:00.515] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [14:07:02.091] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [14:07:03.190] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [14:07:03.991] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [14:07:05.215] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [14:07:06.829] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [14:07:08.280] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [14:07:09.186] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [14:07:10.717] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [14:07:12.260] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [14:07:12.731] [Thread debugging using libthread_db enabled] [14:07:12.731] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [14:07:13.943] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [14:07:15.371] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [14:07:16.428] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [14:07:17.051] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [14:07:17.885] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [14:07:20.167] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [14:07:21.172] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [14:07:21.977] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [14:07:23.242] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [14:07:24.186] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [14:07:25.774] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [14:07:26.835] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [14:07:27.616] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [14:07:28.996] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [14:07:29.622] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [14:07:31.151] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [14:07:31.911] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [14:07:33.134] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [14:07:34.045] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [14:07:35.114] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [14:07:36.030] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [14:07:37.251] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [14:07:37.890] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [14:07:38.806] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [14:07:39.567] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [14:07:40.054] Core was generated by `postgres: cascading_standby: startup waiting for 000000020000000000000006 '. [14:07:40.054] Program terminated with signal SIGQUIT, Quit. [14:07:40.054] #0 0x00007f5f385dbfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.081] [Current thread is 1 (LWP 26402)] [14:07:40.183] [14:07:40.183] Thread 2 (Thread 0x7f5f35f72a40 (LWP 25683)): [14:07:40.183] #0 0x00007f5f3869ea61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.183] No symbol table info available. [14:07:40.183] #1 0x00007f5f3868ce5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.183] No symbol table info available. [14:07:40.183] #2 0x00007f5f3868d497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.183] No symbol table info available. [14:07:40.183] #3 0x00007f5f3868ccdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.183] No symbol table info available. [14:07:40.183] #4 0x00007f5f385e8a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.183] No symbol table info available. [14:07:40.183] #5 0x00005590a2c714c6 in RestoreArchivedFile (path=path@entry=0x7ffeb4d3c0c0 "pg_wal/00000", xlogfname=xlogfname@entry=0x7ffeb4d3c510 "00000002", '0' , "6", recovername=recovername@entry=0x5590a37829dc "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [14:07:40.183] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "\066pg_wal/RECOV\000\000\000\000ISTORY\000\000\b\000\000\000\000\000\000\000\314\361w\243\220U\000\000\350\277Ӵ\376\177\000\000\300\361w\243\220U\000\000\324y]\243\220U\000\000\020\305Ӵ\376\177\000\000\227)x\243\220U\000\000\350\277Ӵ\376\177\000\000\225)x\243\220U\000\000\030)\367\065_\177\000\000\060\204]\243\220U\000\000\301\227w\243\000\000\000\000\000\000\000\000\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [14:07:40.183] xlogRestoreCmd = 0x5590a4a6e648 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/035_standby_logical_decoding/data/t_035_standby_logical_decoding_standby_data/archives/00000002", '0' , "6\" \"pg_wal/RECOVERYXLOG\"" [14:07:40.183] lastRestartPointFname = "00000001", '0' , "6\000\204]\243\220U\000\000\220\272Ӵ\000\000\000\000\000\001\000\000\263f\000\000\300\066w8_\177\000\000`7w8_\177\000\000\263f\000\000\002", '\000' , "\020\215^8_\177\000\000\260\270Ӵ\376\177\000\000\000\000\000\000\377\377\377\377\000\000\000\000\000\000\000\000W\201s8_\177\000\000O\201s8_\177\000\000H榤\220U", '\000' , "@\000\000\000\000\000 \277Ӵ\376\177", '\000' , "(\000\000\000\060"... [14:07:40.183] rc = [14:07:40.183] stat_buf = {st_dev = 94079704452024, st_ino = 335544320, st_nlink = 140046944288096, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 16476594119102583808, st_size = 140046945720761, st_blksize = 94079726052936, st_blocks = 140731932195504, st_atim = {tv_sec = 140731932195088, tv_nsec = 140731932195216}, st_mtim = {tv_sec = 0, tv_nsec = 94079726052936}, st_ctim = {tv_sec = 140046945014935, tv_nsec = 0}, __glibc_reserved = {94079704463828, 140731932198176, 94079706198297}} [14:07:40.183] restartSegNo = [14:07:40.183] restartRedoPtr = 100664744 [14:07:40.183] restartTli = 1 [14:07:40.183] __func__ = "RestoreArchivedFile" [14:07:40.183] #6 0x00005590a2c80156 in XLogFileRead (segno=140731932198080, segno@entry=6, emode=emode@entry=13, tli=tli@entry=2, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4209 [14:07:40.183] xlogfname = "00000002", '0' , "6\000history", '\000' , "\002\000\000\000\000\000\000\000\000\000\000" [14:07:40.183] activitymsg = "waiting for 00000002", '0' , "6\000\177\000\000\324y]\243\220U\000\000𒃣\220U\000\000풃\243\220U\000\000(\310Ӵ\376\177\000\000뒃\243\220U\000" [14:07:40.183] path = "pg_wal/00000\000\000\000\000", '\060' , "\066\000pg_wal/RECOVERYHISTORY\000\000\002\000\000\000\000\000\000\066\000\000\000\000\001\000\000\000\000\000\000\000\000\000\000\063\061\t0/6446\b\000\000\000\000\000\000\000\314\361w\243\220U\000\000\b\000\000\000\000\000\000\000\271\227w\243\220U\000\000H\304Ӵ\376\177\000\000\265\227w\243\220U\000\000\324y]\243\220U\000\000\301\227w\243\220U\000\000\271\227w\243\220U\000\000H\304Ӵ\376\177\000\000\265\227w\243\220U\000\000\030)\367\065_\177\000\000r\203]\243\220U", '\000' ... [14:07:40.183] fd = [14:07:40.183] __func__ = "XLogFileRead" [14:07:40.183] #7 0x00005590a2c80346 in XLogFileReadAnyTLI (segno=6, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4337 [14:07:40.183] hent = [14:07:40.183] tli = 2 [14:07:40.183] cell__state = {l = , i = } [14:07:40.183] path = "\027\031x\243\220U\000\000\030)\367\065_\177\000\000P\310Ӵ\376\177\000\000\024\214]\243\220U\000\000\000\000\000\000\000\000\000\000\302\017\030\244\220U\000\000@\020\030\244\220U\000\000\024\307Ӵ\376\177\000\000\030\222\203\243\220U\000\000\321\017\030\244\220U\000\000@\020\030\244\220U\000\000\064\307Ӵ\376\177\000\000'\222\203\243\220U\000\000@\020\030\244\220U\000\000\002\000\000\000\000\000\000\000ѓ]\243\220U\000\000\066\307Ӵ\376\177\000\000\064\307Ӵ\376\177", '\000' , "U\000\000\030\000\000\000\060\000\000\000\020\307Ӵ\376\177\000\000\252\224]\243\220U\000\000\002\000\000\000\000\000\000\000\030\000\000\000\060\000\000\000"... [14:07:40.183] cell = [14:07:40.183] fd = [14:07:40.183] tles = 0x5590a4a6ed78 [14:07:40.183] __func__ = "XLogFileReadAnyTLI" [14:07:40.183] #8 0x00005590a2c81542 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=105148144, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=105148120, replayTLI=2, replayLSN=105148120, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3770 [14:07:40.183] oldSource = [14:07:40.183] startWalReceiver = false [14:07:40.183] last_fail_time = 768060265707706 [14:07:40.183] now = [14:07:40.183] streaming_reply_sent = true [14:07:40.183] __func__ = "WaitForWALToBecomeAvailable" [14:07:40.183] #9 0x00005590a2c82077 in XLogPageRead (xlogreader=0x5590a4a1bf60, targetPagePtr=105144320, reqLen=3824, targetRecPtr=105148120, readBuf=0x5590a4a6ae18 "\025\321\006") at ../src/backend/access/transam/xlogrecovery.c:3351 [14:07:40.183] private = 0x5590a4a1bf40 [14:07:40.183] emode = 15 [14:07:40.183] targetPageOff = 4481024 [14:07:40.183] targetSegNo = 6 [14:07:40.183] r = [14:07:40.183] __func__ = "XLogPageRead" [14:07:40.183] #10 0x00005590a2c8a4d2 in ReadPageInternal (state=state@entry=0x5590a4a1bf60, pageptr=pageptr@entry=105144320, reqLen=reqLen@entry=3824) at ../src/backend/access/transam/xlogreader.c:1060 [14:07:40.183] readLen = [14:07:40.183] targetPageOff = 4481024 [14:07:40.183] targetSegNo = 6 [14:07:40.183] hdr = [14:07:40.183] #11 0x00005590a2c8c12d in XLogDecodeNextRecord (state=state@entry=0x5590a4a1bf60, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [14:07:40.183] RecPtr = 105148120 [14:07:40.183] record = [14:07:40.183] targetPagePtr = 105144320 [14:07:40.183] randAccess = false [14:07:40.183] len = [14:07:40.183] total_len = [14:07:40.183] targetRecOff = 3800 [14:07:40.183] pageHeaderSize = [14:07:40.183] assembled = false [14:07:40.183] gotheader = [14:07:40.183] readOff = [14:07:40.183] decoded = 0x0 [14:07:40.183] errormsg = 0x5590a3827581 "LOG" [14:07:40.183] #12 0x00005590a2c8cccf in XLogReadAhead (state=0x5590a4a1bf60, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [14:07:40.183] result = [14:07:40.183] #13 0x00005590a2c77611 in XLogPrefetcherNextBlock (pgsr_private=94079725718928, lsn=0x5590a4a80728) at ../src/backend/access/transam/xlogprefetcher.c:492 [14:07:40.183] nonblocking = [14:07:40.183] record = [14:07:40.183] prefetcher = 0x5590a4a1cd90 [14:07:40.183] reader = 0x5590a4a1bf60 [14:07:40.183] replaying_lsn = 105148000 [14:07:40.183] __func__ = "XLogPrefetcherNextBlock" [14:07:40.183] #14 0x00005590a2c7b9da in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [14:07:40.183] No locals. [14:07:40.183] #15 lrq_complete_lsn (lsn=0, lrq=0x5590a4a806c8) at ../src/backend/access/transam/xlogprefetcher.c:290 [14:07:40.183] No locals. [14:07:40.183] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x5590a4a1cd90, errmsg=errmsg@entry=0x7ffeb4d40ca8) at ../src/backend/access/transam/xlogprefetcher.c:1037 [14:07:40.183] record = [14:07:40.183] replayed_up_to = 0 [14:07:40.183] #17 0x00005590a2c828a4 in ReadRecord (xlogprefetcher=0x5590a4a1cd90, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=2) at ../src/backend/access/transam/xlogrecovery.c:3151 [14:07:40.183] errormsg = 0x5590a4a1c770 "" [14:07:40.201] record = [14:07:40.201] xlogreader = 0x5590a4a1bf60 [14:07:40.201] private = [14:07:40.201] __func__ = "ReadRecord" [14:07:40.201] #18 0x00005590a2c85a3b in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [14:07:40.201] xtime = [14:07:40.201] ru0 = {tv = {tv_sec = 1714745062, tv_usec = 920090}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1586}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16088, __ru_maxrss_word = 16088}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 398, __ru_minflt_word = 398}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 3, __ru_nvcsw_word = 3}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [14:07:40.201] record = 0x7f5f35871070 [14:07:40.201] reachedRecoveryTarget = false [14:07:40.201] replayTLI = 2 [14:07:40.201] __func__ = "PerformWalRecovery" [14:07:40.201] #19 0x00005590a2c6f45e in StartupXLOG () at ../src/backend/access/transam/xlog.c:5806 [14:07:40.201] Insert = [14:07:40.201] checkPoint = {redo = 100664744, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 770}, nextOid = 16428, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1714745061, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 769} [14:07:40.201] wasShutdown = false [14:07:40.201] didCrash = [14:07:40.201] haveTblspcMap = false [14:07:40.201] haveBackupLabel = true [14:07:40.201] EndOfLog = [14:07:40.201] EndOfLogTLI = [14:07:40.201] newTLI = [14:07:40.201] performedWalRecovery = [14:07:40.201] endOfRecoveryInfo = [14:07:40.201] abortedRecPtr = [14:07:40.201] missingContrecPtr = [14:07:40.201] oldestActiveXID = [14:07:40.201] promoted = false [14:07:40.201] __func__ = "StartupXLOG" [14:07:40.201] #20 0x00005590a3136905 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [14:07:40.201] No locals. [14:07:40.201] #21 0x00005590a312df21 in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [14:07:40.201] pid = [14:07:40.201] #22 0x00005590a312ff9a in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [14:07:40.201] pid = [14:07:40.201] __func__ = "StartChildProcess" [14:07:40.201] #23 0x00005590a3136064 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x5590a4a1ade0) at ../src/backend/postmaster/postmaster.c:1364 [14:07:40.201] opt = [14:07:40.201] status = [14:07:40.201] userDoption = [14:07:40.201] listen_addr_saved = false [14:07:40.201] output_config_variable = [14:07:40.201] __func__ = "PostmasterMain" [14:07:40.201] #24 0x00005590a2f56757 in main (argc=4, argv=0x5590a4a1ade0) at ../src/backend/main/main.c:197 [14:07:40.201] do_check_root = [14:07:40.201] [14:07:40.201] Thread 1 (LWP 26402): [14:07:40.201] #0 0x00007f5f385dbfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.201] No symbol table info available. [14:07:40.201] #1 0x00007f5f3868d13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.201] No symbol table info available. [14:07:40.201] #2 0x00007f5f3869ea6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:40.201] No symbol table info available. [14:07:40.218] -e [14:07:40.218] [14:07:40.218] [14:07:40.772] dumping /tmp/cores/postgres-3-26134.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [14:07:41.090] [New LWP 26134] [14:07:41.090] [New LWP 24948] [14:07:42.233] [Thread debugging using libthread_db enabled] [14:07:42.233] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [14:07:43.647] Core was generated by `postgres: standby2: startup recovering 000000010000000000000006 '. [14:07:43.647] Program terminated with signal SIGQUIT, Quit. [14:07:43.647] #0 0x00007ff92e545fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.652] [Current thread is 1 (LWP 26134)] [14:07:43.747] [14:07:43.747] Thread 2 (Thread 0x7ff92bedca40 (LWP 24948)): [14:07:43.747] #0 0x00007ff92e608a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.747] No symbol table info available. [14:07:43.747] #1 0x00007ff92e5f6e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.747] No symbol table info available. [14:07:43.747] #2 0x00007ff92e5f7497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.747] No symbol table info available. [14:07:43.747] #3 0x00007ff92e5f6cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.747] No symbol table info available. [14:07:43.747] #4 0x00007ff92e552a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.747] No symbol table info available. [14:07:43.747] #5 0x00005610552dd4c6 in RestoreArchivedFile (path=path@entry=0x7ffe9c681770 "", xlogfname=xlogfname@entry=0x7ffe9c681730 "00000002.history", recovername=recovername@entry=0x561055dee9f0 "RECOVERYHISTORY", expectedSize=expectedSize@entry=0, cleanupEnabled=cleanupEnabled@entry=false) at ../src/backend/access/transam/xlogarchive.c:177 [14:07:43.747] xlogpath = "pg_wal/RECOVERYHISTORY\000\000\b\000\000\000\000\000\000\066\000\000\000\000\000\000\000\000\250>\304U\000\000\000\062\000\000\000\000\000\000\000\000\b\000\000\000\000\000\000\000̱\336U\020V\000\000\b\000\000\000\000\000\000\000\271W\336U\020V\000\000X\026h\234\376\177\000\000\265W\336U\020V\000\000\324\071\304U\020V\000\000\301W\336U\020V\000\000\271W\336U\020V\000\000X\026h\234\376\177\000\000\265W\336U\020V\000\000\030\311\355+\371\177\000\000rC\304U\020V", '\000' , "\b", '\000' , "\060", '\000' , "\002\000\000\000\000\000\000\000"... [14:07:43.747] xlogRestoreCmd = 0x5610580cf5e8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/040_standby_failover_slots_sync/data/t_040_standby_failover_slots_sync_publisher_data/archives/00000002.history\" \"pg_wal/RECOVERYHISTORY\"" [14:07:43.747] lastRestartPointFname = '0' , "\000\351\336U\020V\000\000\370\021h\234\376\177\000\000\243\351\336U\020V\000\000\030\311\355+\371\177\000\000\060D\304U\020V", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [14:07:43.747] rc = [14:07:43.747] stat_buf = {st_dev = 140708160588056, st_ino = 207597356080, st_nlink = 0, st_mode = 0, st_uid = 0, st_gid = 0, __pad0 = 0, st_rdev = 48, st_size = 5922071200885860208, st_blksize = 6366210006019162949, st_blocks = 4673356, st_atim = {tv_sec = 0, tv_nsec = 0}, st_mtim = {tv_sec = 3891110078048108544, tv_nsec = 0}, st_ctim = {tv_sec = 0, tv_nsec = 0}, __glibc_reserved = {8, 94628160123340, 140731522486776}} [14:07:43.747] restartSegNo = [14:07:43.747] restartRedoPtr = 94628158389928 [14:07:43.747] restartTli = 0 [14:07:43.747] __func__ = "RestoreArchivedFile" [14:07:43.747] #6 0x00005610552b1eaf in existsTimeLineHistory (probeTLI=probeTLI@entry=2) at ../src/backend/access/transam/timeline.c:235 [14:07:43.747] path = '\000' , "\001\000\000\000\000\000\000\000\305\303.U\020V\000\000\240\033h\234\376\177\000\000\a\000\000\000\r\000\000\000\001\000\000\000\000\000\000\000\004\000\000\t", '\000' , "\024L\304U\020V\000\000\000\000\000\000\000\000\000\000\302\317~V\020V\000\000@\320~V\020V\000\000\240\037\000\000\377\377\002\000\030R\352U\020V\000\000\321\317~V\020V\000\000@\320~V\020V\000\000D\031h\234\376\177\000\000'R\352U\020V\000\000@\320~V\020V\000\000\002\000\000\000\000\000\000\000\321S\304U\020V\000\000F\031h\234\376\177\000\000D\031h\234\376\177", '\000' ... [14:07:43.747] histfname = "00000002.history", '\000' [14:07:43.747] fd = [14:07:43.747] __func__ = "existsTimeLineHistory" [14:07:43.747] #7 0x00005610552b1f9a in findNewestTimeLine (startTLI=startTLI@entry=1) at ../src/backend/access/transam/timeline.c:277 [14:07:43.747] newestTLI = 1 [14:07:43.747] probeTLI = 2 [14:07:43.747] #8 0x00005610552e8491 in rescanLatestTimeLine (replayTLI=replayTLI@entry=1, replayLSN=replayLSN@entry=100683512) at ../src/backend/access/transam/xlogrecovery.c:4113 [14:07:43.747] newExpectedTLEs = [14:07:43.747] found = [14:07:43.747] cell = [14:07:43.747] newtarget = [14:07:43.747] oldtarget = 1 [14:07:43.747] currentTle = 0x0 [14:07:43.747] __func__ = "rescanLatestTimeLine" [14:07:43.747] #9 0x00005610552ed641 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=100683536, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=100683512, replayTLI=1, replayLSN=100683512, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3674 [14:07:43.747] oldSource = XLOG_FROM_STREAM [14:07:43.747] startWalReceiver = false [14:07:43.747] last_fail_time = 768060264480607 [14:07:43.747] now = [14:07:43.747] streaming_reply_sent = true [14:07:43.747] __func__ = "WaitForWALToBecomeAvailable" [14:07:43.747] #10 0x00005610552ee077 in XLogPageRead (xlogreader=0x56105807cf30, targetPagePtr=100679680, reqLen=3856, targetRecPtr=100683512, readBuf=0x5610580cbdb8 "\025\321\006") at ../src/backend/access/transam/xlogrecovery.c:3351 [14:07:43.747] private = 0x56105807cf10 [14:07:43.747] emode = 15 [14:07:43.747] targetPageOff = 16384 [14:07:43.747] targetSegNo = 6 [14:07:43.747] r = [14:07:43.747] __func__ = "XLogPageRead" [14:07:43.747] #11 0x00005610552f64d2 in ReadPageInternal (state=state@entry=0x56105807cf30, pageptr=pageptr@entry=100679680, reqLen=reqLen@entry=3856) at ../src/backend/access/transam/xlogreader.c:1060 [14:07:43.747] readLen = [14:07:43.747] targetPageOff = 16384 [14:07:43.747] targetSegNo = 6 [14:07:43.747] hdr = [14:07:43.747] #12 0x00005610552f812d in XLogDecodeNextRecord (state=state@entry=0x56105807cf30, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [14:07:43.747] RecPtr = 100683512 [14:07:43.747] record = [14:07:43.747] targetPagePtr = 100679680 [14:07:43.747] randAccess = false [14:07:43.747] len = [14:07:43.747] total_len = [14:07:43.747] targetRecOff = 3832 [14:07:43.747] pageHeaderSize = [14:07:43.747] assembled = false [14:07:43.747] gotheader = [14:07:43.747] readOff = [14:07:43.747] decoded = 0x0 [14:07:43.747] errormsg = 0x561055e93581 "LOG" [14:07:43.747] #13 0x00005610552f8ccf in XLogReadAhead (state=0x56105807cf30, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [14:07:43.747] result = [14:07:43.747] #14 0x00005610552e3611 in XLogPrefetcherNextBlock (pgsr_private=94628196375904, lsn=0x5610580e1738) at ../src/backend/access/transam/xlogprefetcher.c:492 [14:07:43.747] nonblocking = [14:07:43.747] record = [14:07:43.747] prefetcher = 0x56105807dd60 [14:07:43.747] reader = 0x56105807cf30 [14:07:43.747] replaying_lsn = 100683464 [14:07:43.747] __func__ = "XLogPrefetcherNextBlock" [14:07:43.747] #15 0x00005610552e79da in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [14:07:43.747] No locals. [14:07:43.747] #16 lrq_complete_lsn (lsn=0, lrq=0x5610580e1668) at ../src/backend/access/transam/xlogprefetcher.c:290 [14:07:43.747] No locals. [14:07:43.747] #17 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x56105807dd60, errmsg=errmsg@entry=0x7ffe9c685eb8) at ../src/backend/access/transam/xlogprefetcher.c:1037 [14:07:43.747] record = [14:07:43.747] replayed_up_to = 0 [14:07:43.747] #18 0x00005610552ee8a4 in ReadRecord (xlogprefetcher=0x56105807dd60, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [14:07:43.747] errormsg = 0x56105807d740 "" [14:07:43.747] record = [14:07:43.747] xlogreader = 0x56105807cf30 [14:07:43.747] private = [14:07:43.747] __func__ = "ReadRecord" [14:07:43.747] #19 0x00005610552f1a3b in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [14:07:43.747] xtime = [14:07:43.747] ru0 = {tv = {tv_sec = 1714745059, tv_usec = 463354}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1542}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 16476, __ru_maxrss_word = 16476}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 408, __ru_minflt_word = 408}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [14:07:43.747] record = 0x7ff92b796f70 [14:07:43.747] reachedRecoveryTarget = false [14:07:43.747] replayTLI = 1 [14:07:43.763] __func__ = "PerformWalRecovery" [14:07:43.763] #20 0x00005610552db45e in StartupXLOG () at ../src/backend/access/transam/xlog.c:5806 [14:07:43.763] Insert = [14:07:43.763] checkPoint = {redo = 83886120, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 751}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1714745058, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 751} [14:07:43.763] wasShutdown = false [14:07:43.763] didCrash = [14:07:43.763] haveTblspcMap = false [14:07:43.763] haveBackupLabel = true [14:07:43.763] EndOfLog = [14:07:43.763] EndOfLogTLI = [14:07:43.763] newTLI = [14:07:43.763] performedWalRecovery = [14:07:43.763] endOfRecoveryInfo = [14:07:43.763] abortedRecPtr = [14:07:43.763] missingContrecPtr = [14:07:43.763] oldestActiveXID = [14:07:43.763] promoted = false [14:07:43.763] __func__ = "StartupXLOG" [14:07:43.763] #21 0x00005610557a2905 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [14:07:43.763] No locals. [14:07:43.763] #22 0x0000561055799f21 in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [14:07:43.763] pid = [14:07:43.763] #23 0x000056105579bf9a in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [14:07:43.763] pid = [14:07:43.763] __func__ = "StartChildProcess" [14:07:43.763] #24 0x00005610557a2064 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x56105807bdf0) at ../src/backend/postmaster/postmaster.c:1364 [14:07:43.763] opt = [14:07:43.763] status = [14:07:43.763] userDoption = [14:07:43.763] listen_addr_saved = false [14:07:43.763] output_config_variable = [14:07:43.763] __func__ = "PostmasterMain" [14:07:43.763] #25 0x00005610555c2757 in main (argc=4, argv=0x56105807bdf0) at ../src/backend/main/main.c:197 [14:07:43.763] do_check_root = [14:07:43.763] [14:07:43.763] Thread 1 (LWP 26134): [14:07:43.763] #0 0x00007ff92e545fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.763] No symbol table info available. [14:07:43.763] #1 0x00007ff92e5f713a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.763] No symbol table info available. [14:07:43.763] #2 0x00007ff92e608a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [14:07:43.763] No symbol table info available.