[16:47:02.601] src/tools/ci/cores_backtrace.sh linux /tmp/cores [16:47:03.297] dumping /tmp/cores/postgres-3-31933.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [16:47:05.119] [New LWP 31933] [16:47:05.119] [New LWP 31795] [16:47:05.119] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [16:47:06.072] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [16:47:06.982] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [16:47:08.237] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [16:47:10.762] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [16:47:10.762] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [16:47:12.821] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [16:47:14.034] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [16:47:15.674] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [16:47:16.773] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [16:47:17.557] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [16:47:18.878] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [16:47:20.562] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [16:47:22.003] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [16:47:22.912] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [16:47:24.444] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [16:47:25.975] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [16:47:26.444] [Thread debugging using libthread_db enabled] [16:47:26.444] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [16:47:27.512] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [16:47:28.938] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [16:47:30.000] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [16:47:30.624] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [16:47:31.474] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [16:47:33.953] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [16:47:34.892] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [16:47:35.688] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [16:47:36.966] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [16:47:37.893] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [16:47:39.537] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [16:47:40.629] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [16:47:41.408] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [16:47:42.820] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [16:47:43.442] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [16:47:44.971] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [16:47:45.729] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [16:47:46.952] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [16:47:47.735] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [16:47:48.818] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [16:47:49.759] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [16:47:51.002] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [16:47:51.625] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [16:47:52.560] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [16:47:53.335] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [16:47:53.825] Core was generated by `postgres: replica_success: startup waiting for 000000010000000000000004 '. [16:47:53.825] Program terminated with signal SIGQUIT, Quit. [16:47:53.825] #0 0x00007f1d12330fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.852] [Current thread is 1 (LWP 31933)] [16:47:53.960] [16:47:53.960] Thread 2 (Thread 0x7f1d0fcc7a40 (LWP 31795)): [16:47:53.960] #0 0x00007f1d123f3a61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.960] No symbol table info available. [16:47:53.960] #1 0x00007f1d123e1e5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.960] No symbol table info available. [16:47:53.960] #2 0x00007f1d123e2497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.960] No symbol table info available. [16:47:53.960] #3 0x00007f1d123e1cdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.960] No symbol table info available. [16:47:53.960] #4 0x00007f1d1233da69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.960] No symbol table info available. [16:47:53.960] #5 0x000055ea915bee9e in RestoreArchivedFile (path=path@entry=0x7fffdb08d090 "0\324\b\333\377\177", xlogfname=xlogfname@entry=0x7fffdb08d4e0 "00000001", '0' , "4", recovername=recovername@entry=0x55ea920985bc "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [16:47:53.960] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "pg_wal/000000014", '0' , '\000' , "\b\000\000\000\000\000\000\000\234M\t\222\352U\000\000\270\317\b\333\377\177\000\000\220M\t\222\352U\000\000\024\336\357\221\352U\000\000\340\324\b\333\377\177\000\000w\205\t\222\352U\000\000\270\317\b\333\377\177\000\000u\205\t\222\352U\000\000\030y\314\017\035\177\000\000p\350\357\221\352U", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [16:47:53.960] xlogRestoreCmd = 0x55ea92f79588 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/042_low_level_backup/data/t_042_low_level_backup_primary_data/archives/00000001", '0' , "4\" \"pg_wal/RECOVERYXLOG\"" [16:47:53.960] lastRestartPointFname = "00000001", '0' , "2\000\350\357\221\352U", '\000' , "\001\000\000{|\000\000\300\206L\022\035\177\000\000`\207L\022\035\177\000\000{|\000\000\002", '\000' , "\020\335\063\022\035\177\000\000\200\310\b\333\377\177", '\000' , "W\321H\022\035\177\000\000O\321H\022\035\177\000\000\210\225\367\222\352U", '\000' , "@", '\000' ... [16:47:53.960] rc = [16:47:53.960] stat_buf = {st_dev = 94465959112696, st_ino = 335544320, st_nlink = 139762836114784, st_mode = 0, st_uid = 0, st_gid = 1003, __pad0 = 0, st_rdev = 15200931824481130496, st_size = 16777216, st_blksize = 94465976407432, st_blocks = 140736868174464, st_atim = {tv_sec = 140736868174048, tv_nsec = 140736868174176}, st_mtim = {tv_sec = 0, tv_nsec = 94465976407432}, st_ctim = {tv_sec = 139762836841623, tv_nsec = 0}, __glibc_reserved = {94465959124500, 140736868177136, 94465960791273}} [16:47:53.960] restartSegNo = [16:47:53.960] restartRedoPtr = 33554472 [16:47:53.960] restartTli = 1 [16:47:53.960] __func__ = "RestoreArchivedFile" [16:47:53.960] #6 0x000055ea915cdb2e in XLogFileRead (segno=140736868177040, segno@entry=4, emode=emode@entry=13, tli=tli@entry=1, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4209 [16:47:53.960] xlogfname = "00000001", '0' , "4\000\066\310\023\035\177\000\000(|\244\222\352U\000\000\237\001\000\000\000\000\000\000\001\000\000\000\000\000\000\000\250e\362\222\352U\000" [16:47:53.960] activitymsg = "waiting for 00000001", '0' , "4\000\000\000\000\237\001\000\000\000\000\000\000\001\000\000\000\000\000\000\000#\306\307\023\035\177\000\000\001", '\000' [16:47:53.960] path = "0\324\b\333\377\177\000\000\060\324\b\333\000\000\000\000\001\000\000\000\000\000\000\000\320\334\357\221\352U\000\000pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\350\342\357\221\352U\000\062", '\000' , "\b\000\000\000\000\000\000\000\031\363\b\222\352U\000\000\030\324\b\333\377\177\000\000\025\363\b\222\352U\000\000\024\336\357\221\352U\000\000!\363\b\222\352U\000\000\031\363\b\222\352U\000\000\030\324\b\333\377\177\000\000\025\363\b\222\352U\000\000\030y\314\017\035\177\000\000\262\347\357\221\352U", '\000' ... [16:47:53.960] fd = [16:47:53.960] __func__ = "XLogFileRead" [16:47:53.960] #7 0x000055ea915cdd1e in XLogFileReadAnyTLI (segno=4, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4337 [16:47:53.960] hent = [16:47:53.960] tli = 1 [16:47:53.960] cell__state = {l = , i = } [16:47:53.960] path = "\001\000\000\000\000\000\000\000\004\000\000\t", '\000' , "T\360\357\221\352U\000\000\000\000\000\000\000\000\000\000\342륒\352U\000\000`쥒\352U\000\000\240\037\000\000\377\377\002\000\030\270\024\222\352U\000\000\361륒\352U\000\000`쥒\352U\000\000\004\327\b\333\377\177\000\000'\270\024\222\352U\000\000`쥒\352U\000\000\002\000\000\000\000\000\000\000\021\370\357\221\352U\000\000", '\177' , "\000\000\000\000\000\000\000\000\000\000\377\377", '\000' , "\377\000\000\000\000\000LC_MESSAGES\000LC_P", '\\' , "8\313"... [16:47:53.960] cell = [16:47:53.960] fd = [16:47:53.960] tles = 0x55ea92f8bd38 [16:47:53.960] __func__ = "XLogFileReadAnyTLI" [16:47:53.960] #8 0x000055ea915cef1a in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=67108888, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=67108864, replayTLI=1, replayLSN=67108864, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3770 [16:47:53.960] oldSource = [16:47:53.960] startWalReceiver = false [16:47:53.960] last_fail_time = 764268281947996 [16:47:53.960] now = [16:47:53.960] streaming_reply_sent = false [16:47:53.960] __func__ = "WaitForWALToBecomeAvailable" [16:47:53.960] #9 0x000055ea915cfa4f in XLogPageRead (xlogreader=0x55ea92f26ed0, targetPagePtr=67108864, reqLen=24, targetRecPtr=67108864, readBuf=0x55ea92f75d58 "\024\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [16:47:53.960] private = 0x55ea92f26eb0 [16:47:53.960] emode = 15 [16:47:53.960] targetPageOff = 0 [16:47:53.960] targetSegNo = 4 [16:47:53.960] r = [16:47:53.960] __func__ = "XLogPageRead" [16:47:53.960] #10 0x000055ea915d7eaa in ReadPageInternal (state=state@entry=0x55ea92f26ed0, pageptr=pageptr@entry=67108864, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [16:47:53.960] readLen = [16:47:53.960] targetPageOff = 0 [16:47:53.960] targetSegNo = 4 [16:47:53.960] hdr = [16:47:53.960] #11 0x000055ea915d9b05 in XLogDecodeNextRecord (state=state@entry=0x55ea92f26ed0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [16:47:53.960] RecPtr = 67108864 [16:47:53.960] record = [16:47:53.960] targetPagePtr = 67108864 [16:47:53.960] randAccess = false [16:47:53.960] len = [16:47:53.960] total_len = [16:47:53.960] targetRecOff = 0 [16:47:53.960] pageHeaderSize = [16:47:53.960] assembled = false [16:47:53.960] gotheader = [16:47:53.960] readOff = [16:47:53.960] decoded = 0x0 [16:47:53.960] errormsg = 0x40000000062 [16:47:53.960] #12 0x000055ea915da6a7 in XLogReadAhead (state=0x55ea92f26ed0, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [16:47:53.960] result = [16:47:53.960] #13 0x000055ea915c4fe9 in XLogPrefetcherNextBlock (pgsr_private=94465976073472, lsn=0x55ea92f8b8b8) at ../src/backend/access/transam/xlogprefetcher.c:492 [16:47:53.960] nonblocking = [16:47:53.960] record = [16:47:53.960] prefetcher = 0x55ea92f27d00 [16:47:53.960] reader = 0x55ea92f26ed0 [16:47:53.960] replaying_lsn = 50331936 [16:47:53.960] __func__ = "XLogPrefetcherNextBlock" [16:47:53.960] #14 0x000055ea915c93b2 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [16:47:53.960] No locals. [16:47:53.960] #15 lrq_complete_lsn (lsn=67108864, lrq=0x55ea92f8b608) at ../src/backend/access/transam/xlogprefetcher.c:290 [16:47:53.960] No locals. [16:47:53.960] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x55ea92f27d00, errmsg=errmsg@entry=0x7fffdb091c78) at ../src/backend/access/transam/xlogprefetcher.c:1037 [16:47:53.960] record = [16:47:53.960] replayed_up_to = 67108864 [16:47:53.960] #17 0x000055ea915d027c in ReadRecord (xlogprefetcher=0x55ea92f27d00, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [16:47:53.960] errormsg = 0x55ea91abbeee "AUATUSH\203\354\bH\205\377\017\204:\001" [16:47:53.979] record = [16:47:53.979] xlogreader = 0x55ea92f26ed0 [16:47:53.979] private = [16:47:53.979] __func__ = "ReadRecord" [16:47:53.979] #18 0x000055ea915d3413 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [16:47:53.979] xtime = [16:47:53.979] ru0 = {tv = {tv_sec = 1710953081, tv_usec = 116617}, ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 1557}, {ru_maxrss = 15980, __ru_maxrss_word = 15980}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 403, __ru_minflt_word = 403}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 4, __ru_nvcsw_word = 4}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [16:47:53.979] record = 0x7f1d0f59be50 [16:47:53.979] reachedRecoveryTarget = false [16:47:53.979] replayTLI = 1 [16:47:53.979] __func__ = "PerformWalRecovery" [16:47:53.979] #19 0x000055ea915bd0c0 in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [16:47:53.979] Insert = [16:47:53.979] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 738}, nextOid = 14205, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1710953077, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 738} [16:47:53.979] wasShutdown = false [16:47:53.979] didCrash = [16:47:53.979] haveTblspcMap = false [16:47:53.979] haveBackupLabel = true [16:47:53.979] EndOfLog = [16:47:53.979] EndOfLogTLI = [16:47:53.979] newTLI = [16:47:53.979] performedWalRecovery = [16:47:53.979] endOfRecoveryInfo = [16:47:53.979] abortedRecPtr = [16:47:53.979] missingContrecPtr = [16:47:53.979] oldestActiveXID = [16:47:53.979] promoted = false [16:47:53.979] __func__ = "StartupXLOG" [16:47:53.979] #20 0x000055ea91a6ddb0 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [16:47:53.979] No locals. [16:47:53.979] #21 0x000055ea91a6557a in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [16:47:53.979] pid = [16:47:53.979] #22 0x000055ea91a67445 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [16:47:53.979] pid = [16:47:53.979] __func__ = "StartChildProcess" [16:47:53.979] #23 0x000055ea91a6d50f in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x55ea92f25d60) at ../src/backend/postmaster/postmaster.c:1364 [16:47:53.979] opt = [16:47:53.979] status = [16:47:53.979] userDoption = [16:47:53.979] listen_addr_saved = false [16:47:53.979] output_config_variable = [16:47:53.979] __func__ = "PostmasterMain" [16:47:53.979] #24 0x000055ea918998ff in main (argc=4, argv=0x55ea92f25d60) at ../src/backend/main/main.c:197 [16:47:53.979] do_check_root = [16:47:53.979] [16:47:53.979] Thread 1 (LWP 31933): [16:47:53.979] #0 0x00007f1d12330fc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.979] No symbol table info available. [16:47:53.979] #1 0x00007f1d123e213a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.979] No symbol table info available. [16:47:53.979] #2 0x00007f1d123f3a6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [16:47:53.979] No symbol table info available.