[06:39:16.333] src/tools/ci/cores_backtrace.sh linux /tmp/cores [06:39:17.041] dumping /tmp/cores/postgres-3-21339.core for /tmp/cirrus-ci-build/build/tmp_install/usr/local/pgsql/bin/postgres [06:39:18.958] [New LWP 21339] [06:39:18.958] [New LWP 20243] [06:39:18.958] Downloading separate debug info for /lib/x86_64-linux-gnu/libm.so.6... [06:39:19.743] Downloading separate debug info for /lib/x86_64-linux-gnu/libdl.so.2... [06:39:20.688] Downloading separate debug info for /lib/x86_64-linux-gnu/librt.so.1... [06:39:21.948] Downloading separate debug info for /lib/x86_64-linux-gnu/libgssapi_krb5.so.2... [06:39:24.570] Downloading separate debug info for /lib/x86_64-linux-gnu/libicuuc.so.67... [06:39:24.570] Downloading separate debug info for /.cache/debuginfod_client/f871bbd529a02abd860f0d16b842b5b20234cb49/debuginfo... [06:39:26.647] Downloading separate debug info for /lib/x86_64-linux-gnu/libicui18n.so.67... [06:39:27.858] Downloading separate debug info for /lib/x86_64-linux-gnu/libldap_r-2.4.so.2... [06:39:29.519] Downloading separate debug info for /lib/x86_64-linux-gnu/libxml2.so.2... [06:39:30.638] Downloading separate debug info for /lib/x86_64-linux-gnu/liblz4.so.1... [06:39:31.463] Downloading separate debug info for /lib/x86_64-linux-gnu/libpam.so.0... [06:39:32.818] Downloading separate debug info for /lib/x86_64-linux-gnu/libssl.so.1.1... [06:39:34.533] Downloading separate debug info for /lib/x86_64-linux-gnu/libcrypto.so.1.1... [06:39:36.011] Downloading separate debug info for /lib/x86_64-linux-gnu/libsystemd.so.0... [06:39:36.919] Downloading separate debug info for /lib/x86_64-linux-gnu/libz.so.1... [06:39:38.455] Downloading separate debug info for /lib/x86_64-linux-gnu/libzstd.so.1... [06:39:40.020] Downloading separate debug info for /lib/x86_64-linux-gnu/libpthread.so.0... [06:39:40.501] [Thread debugging using libthread_db enabled] [06:39:40.501] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". [06:39:41.738] Downloading separate debug info for /lib64/ld-linux-x86-64.so.2... [06:39:43.164] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5.so.3... [06:39:44.227] Downloading separate debug info for /lib/x86_64-linux-gnu/libk5crypto.so.3... [06:39:44.861] Downloading separate debug info for /lib/x86_64-linux-gnu/libcom_err.so.2... [06:39:45.725] Downloading separate debug info for /lib/x86_64-linux-gnu/libkrb5support.so.0... [06:39:48.312] Downloading separate debug info for /lib/x86_64-linux-gnu/libstdc++.so.6... [06:39:49.278] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcc_s.so.1... [06:39:50.107] Downloading separate debug info for /lib/x86_64-linux-gnu/liblber-2.4.so.2... [06:39:51.404] Downloading separate debug info for /lib/x86_64-linux-gnu/libresolv.so.2... [06:39:52.358] Downloading separate debug info for /lib/x86_64-linux-gnu/libsasl2.so.2... [06:39:54.051] Downloading separate debug info for /lib/x86_64-linux-gnu/libgnutls.so.30... [06:39:55.166] Downloading separate debug info for /lib/x86_64-linux-gnu/liblzma.so.5... [06:39:55.984] Downloading separate debug info for /lib/x86_64-linux-gnu/libaudit.so.1... [06:39:57.446] Downloading separate debug info for /lib/x86_64-linux-gnu/libgcrypt.so.20... [06:39:58.097] Downloading separate debug info for /lib/x86_64-linux-gnu/libkeyutils.so.1... [06:39:59.660] Downloading separate debug info for /lib/x86_64-linux-gnu/libp11-kit.so.0... [06:40:00.436] Downloading separate debug info for /lib/x86_64-linux-gnu/libidn2.so.0... [06:40:01.666] Downloading separate debug info for /lib/x86_64-linux-gnu/libunistring.so.2... [06:40:02.469] Downloading separate debug info for /lib/x86_64-linux-gnu/libtasn1.so.6... [06:40:03.579] Downloading separate debug info for /lib/x86_64-linux-gnu/libnettle.so.8... [06:40:04.541] Downloading separate debug info for /lib/x86_64-linux-gnu/libhogweed.so.6... [06:40:05.819] Downloading separate debug info for /lib/x86_64-linux-gnu/libgmp.so.10... [06:40:06.483] Downloading separate debug info for /lib/x86_64-linux-gnu/libcap-ng.so.0... [06:40:07.453] Downloading separate debug info for /lib/x86_64-linux-gnu/libgpg-error.so.0... [06:40:08.256] Downloading separate debug info for /lib/x86_64-linux-gnu/libffi.so.7... [06:40:08.758] Core was generated by `postgres: standby: startup waiting for 000000010000000000000005 '. [06:40:08.758] Program terminated with signal SIGQUIT, Quit. [06:40:08.758] #0 0x00007f00337ebfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.786] [Current thread is 1 (LWP 21339)] [06:40:08.912] [06:40:08.912] Thread 2 (Thread 0x7f0031182a40 (LWP 20243)): [06:40:08.912] #0 0x00007f00338aea61 in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.912] No symbol table info available. [06:40:08.912] #1 0x00007f003389ce5e in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.912] No symbol table info available. [06:40:08.912] #2 0x00007f003389d497 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.912] No symbol table info available. [06:40:08.912] #3 0x00007f003389ccdb in posix_spawn () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.912] No symbol table info available. [06:40:08.912] #4 0x00007f00337f8a69 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.912] No symbol table info available. [06:40:08.912] #5 0x000055b0aa98ecbd in RestoreArchivedFile (path=path@entry=0x7fffd1921870 "\020\034\222\321\377\177", xlogfname=xlogfname@entry=0x7fffd1921cc0 "00000001", '0' , "5", recovername=recovername@entry=0x55b0ab47adbc "RECOVERYXLOG", expectedSize=16777216, cleanupEnabled=) at ../src/backend/access/transam/xlogarchive.c:177 [06:40:08.912] xlogpath = "pg_wal/RECOVERYXLOG", '\000' , "pg_wal/000000015", '0' , '\000' , "\b\000\000\000\000\000\000\000\204uG\253\260U\000\000\230\027\222\321\377\177\000\000xuG\253\260U\000\000Ü-\253\260U\000\000\300\034\222\321\377\177\000\000w\255G\253\260U\000\000\230\027\222\321\377\177\000\000u\255G\253\260U\000\000\030)\030\061\000\177\000\000\037\247-\253\260U", '\000' , "\b", '\000' , "\060", '\000' , "\002", '\000' ... [06:40:08.912] xlogRestoreCmd = 0x55b0ada445c8 "cp \"/tmp/cirrus-ci-build/build/testrun/recovery/020_archive_status/data/t_020_archive_status_primary_data/archives/00000001", '0' , "5\" \"pg_wal/RECOVERYXLOG\"" [06:40:08.912] lastRestartPointFname = "00000001", '0' , "2\000\247-\253\260U", '\000' , "\001\000\000\351R\000\000\300\066\230\063\000\177\000\000`7\230\063\000\177\000\000\351R\000\000\002", '\000' , "\020\215\177\063\000\177\000\000`\020\222\321\377\177", '\000' , "W\201\224\063\000\177\000\000O\201\224\063\000\177\000\000\310E\244\255\260U", '\000' , "@", '\000' ... [06:40:08.912] rc = [06:40:08.912] stat_buf = {st_dev = 94217274486439, st_ino = 335544320, st_nlink = 139638840671584, st_mode = 0, st_uid = 0, st_gid = 1003, __pad0 = 0, st_rdev = 11547895258583288064, st_size = 16777216, st_blksize = 94217315829192, st_blocks = 140736709399136, st_atim = {tv_sec = 140736709398720, tv_nsec = 140736709398848}, st_mtim = {tv_sec = 0, tv_nsec = 94217315829192}, st_ctim = {tv_sec = 139638841398423, tv_nsec = 0}, __glibc_reserved = {94217274498243, 140736709401808, 94217276191953}} [06:40:08.912] restartSegNo = [06:40:08.912] restartRedoPtr = 33563696 [06:40:08.912] restartTli = 1 [06:40:08.912] __func__ = "RestoreArchivedFile" [06:40:08.912] #6 0x000055b0aa99d94d in XLogFileRead (segno=140736709401712, segno@entry=5, emode=emode@entry=13, tli=tli@entry=1, source=source@entry=XLOG_FROM_ARCHIVE, notfoundOk=notfoundOk@entry=true) at ../src/backend/access/transam/xlogrecovery.c:4209 [06:40:08.912] xlogfname = "00000001", '0' , "5\000history\000\000\000\t\000\000\000\000\200\226{3\000\177\000\000\200 \222\321\002\000\000\000\212\346\023\065\000\000\000" [06:40:08.912] activitymsg = "waiting for 00000001", '0' , "5\000\177\000\000Ü-\253\260U\000\000\020\357R\253\260U\000\000\r\357R\253\260U\000\000\330\037\222\321\377\177\000\000\v\357R\253\260U\000" [06:40:08.912] path = "\020\034\222\321\377\177\000\000\020\034\222\321\000\000\000\000\001\000\000\000\000\000\000\000\177\233-\253\260U\000\000pg_wal/RECOVERYHISTORY\000\000\b", '\000' , "\227\241-\253\260U\000\062", '\000' , "\b\000\000\000\000\000\000\000Y\032G\253\260U\000\000\370\033\222\321\377\177\000\000U\032G\253\260U\000\000Ü-\253\260U\000\000a\032G\253\260U\000\000Y\032G\253\260U\000\000\370\033\222\321\377\177\000\000U\032G\253\260U\000\000\030)\030\061\000\177\000\000a\246-\253\260U", '\000' ... [06:40:08.912] fd = [06:40:08.912] __func__ = "XLogFileRead" [06:40:08.912] #7 0x000055b0aa99db3d in XLogFileReadAnyTLI (segno=5, emode=emode@entry=13, source=XLOG_FROM_ANY) at ../src/backend/access/transam/xlogrecovery.c:4337 [06:40:08.912] hent = [06:40:08.912] tli = 1 [06:40:08.912] cell__state = {l = , i = } [06:40:08.912] path = "\367\234G\253\260U\000\000\030)\030\061\000\177\000\000\000 \222\321\377\177\000\000\003\257-\253\260U\000\000\000\000\000\000\000\000\000\000\342\204嫰U\000\000`\205嫰U\000\000\304\036\222\321\377\177\000\000\070\356R\253\260U\000\000\361\204嫰U\000\000`\205嫰U\000\000\344\036\222\321\377\177\000\000G\356R\253\260U\000\000`\205嫰U\000\000\002\000\000\000\000\000\000\000\300\266-\253\260U\000\000\346\036\222\321\377\177\000\000\344\036\222\321\377\177", '\000' , "\177\177\177\030\000\000\000\060\000\000\000\300\036\222\321\377\177\000\000\231\267-\253\260U\000\000\000\000\377\000\000\000\000\000\030\000\000\000\060\000\000\000\340\036"... [06:40:08.912] cell = [06:40:08.912] fd = [06:40:08.912] tles = 0x55b0ada56d78 [06:40:08.912] __func__ = "XLogFileReadAnyTLI" [06:40:08.912] #8 0x000055b0aa99ed39 in WaitForWALToBecomeAvailable (RecPtr=RecPtr@entry=83886104, randAccess=false, fetching_ckpt=false, tliRecPtr=tliRecPtr@entry=83886080, replayTLI=1, replayLSN=83886080, nonblocking=false) at ../src/backend/access/transam/xlogrecovery.c:3770 [06:40:08.912] oldSource = [06:40:08.912] startWalReceiver = false [06:40:08.912] last_fail_time = 765009382751856 [06:40:08.912] now = [06:40:08.912] streaming_reply_sent = false [06:40:08.912] __func__ = "WaitForWALToBecomeAvailable" [06:40:08.912] #9 0x000055b0aa99f86e in XLogPageRead (xlogreader=0x55b0ad9f1f20, targetPagePtr=83886080, reqLen=24, targetRecPtr=83886080, readBuf=0x55b0ada40d98 "\025\321\002") at ../src/backend/access/transam/xlogrecovery.c:3351 [06:40:08.912] private = 0x55b0ad9f1f00 [06:40:08.912] emode = 15 [06:40:08.912] targetPageOff = 0 [06:40:08.912] targetSegNo = 5 [06:40:08.912] r = [06:40:08.912] __func__ = "XLogPageRead" [06:40:08.912] #10 0x000055b0aa9a7cc9 in ReadPageInternal (state=state@entry=0x55b0ad9f1f20, pageptr=pageptr@entry=83886080, reqLen=reqLen@entry=24) at ../src/backend/access/transam/xlogreader.c:1060 [06:40:08.912] readLen = [06:40:08.912] targetPageOff = 0 [06:40:08.912] targetSegNo = 5 [06:40:08.912] hdr = [06:40:08.912] #11 0x000055b0aa9a9924 in XLogDecodeNextRecord (state=state@entry=0x55b0ad9f1f20, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:597 [06:40:08.912] RecPtr = 83886080 [06:40:08.912] record = [06:40:08.912] targetPagePtr = 83886080 [06:40:08.912] randAccess = false [06:40:08.912] len = [06:40:08.912] total_len = [06:40:08.912] targetRecOff = 0 [06:40:08.912] pageHeaderSize = [06:40:08.912] assembled = false [06:40:08.912] gotheader = [06:40:08.912] readOff = [06:40:08.912] decoded = 0x0 [06:40:08.912] errormsg = 0x55b0ad9f1f20 "\t\366\231\252\260U" [06:40:08.912] #12 0x000055b0aa9aa4c6 in XLogReadAhead (state=0x55b0ad9f1f20, nonblocking=nonblocking@entry=false) at ../src/backend/access/transam/xlogreader.c:973 [06:40:08.912] result = [06:40:08.912] #13 0x000055b0aa994e08 in XLogPrefetcherNextBlock (pgsr_private=94217315495248, lsn=0x55b0ada56748) at ../src/backend/access/transam/xlogprefetcher.c:492 [06:40:08.912] nonblocking = [06:40:08.912] record = [06:40:08.912] prefetcher = 0x55b0ad9f2d50 [06:40:08.912] reader = 0x55b0ad9f1f20 [06:40:08.912] replaying_lsn = 67109152 [06:40:08.912] __func__ = "XLogPrefetcherNextBlock" [06:40:08.912] #14 0x000055b0aa9991d1 in lrq_prefetch (lrq=) at ../src/backend/access/transam/xlogprefetcher.c:252 [06:40:08.912] No locals. [06:40:08.912] #15 lrq_complete_lsn (lsn=83886080, lrq=0x55b0ada56648) at ../src/backend/access/transam/xlogprefetcher.c:290 [06:40:08.912] No locals. [06:40:08.912] #16 XLogPrefetcherReadRecord (prefetcher=prefetcher@entry=0x55b0ad9f2d50, errmsg=errmsg@entry=0x7fffd1926458) at ../src/backend/access/transam/xlogprefetcher.c:1037 [06:40:08.912] record = [06:40:08.912] replayed_up_to = 83886080 [06:40:08.912] #17 0x000055b0aa9a009b in ReadRecord (xlogprefetcher=0x55b0ad9f2d50, emode=emode@entry=15, fetching_ckpt=fetching_ckpt@entry=false, replayTLI=1) at ../src/backend/access/transam/xlogrecovery.c:3151 [06:40:08.912] errormsg = 0x55b0aae92828 "AUATUSH\203\354\bH\205\377\017\204:\001" [06:40:08.931] record = [06:40:08.931] xlogreader = 0x55b0ad9f1f20 [06:40:08.931] private = [06:40:08.931] __func__ = "ReadRecord" [06:40:08.931] #18 0x000055b0aa9a3232 in PerformWalRecovery () at ../src/backend/access/transam/xlogrecovery.c:1832 [06:40:08.931] xtime = [06:40:08.931] ru0 = {tv = {tv_sec = 1711694179, tv_usec = 163938}, ru = {ru_utime = {tv_sec = 0, tv_usec = 1235}, ru_stime = {tv_sec = 0, tv_usec = 0}, {ru_maxrss = 15780, __ru_maxrss_word = 15780}, {ru_ixrss = 0, __ru_ixrss_word = 0}, {ru_idrss = 0, __ru_idrss_word = 0}, {ru_isrss = 0, __ru_isrss_word = 0}, {ru_minflt = 400, __ru_minflt_word = 400}, {ru_majflt = 5, __ru_majflt_word = 5}, {ru_nswap = 0, __ru_nswap_word = 0}, {ru_inblock = 0, __ru_inblock_word = 0}, {ru_oublock = 0, __ru_oublock_word = 0}, {ru_msgsnd = 0, __ru_msgsnd_word = 0}, {ru_msgrcv = 0, __ru_msgrcv_word = 0}, {ru_nsignals = 0, __ru_nsignals_word = 0}, {ru_nvcsw = 2, __ru_nvcsw_word = 2}, {ru_nivcsw = 1, __ru_nivcsw_word = 1}}} [06:40:08.931] record = 0x7f0030a3c1f0 [06:40:08.931] reachedRecoveryTarget = false [06:40:08.931] replayTLI = 1 [06:40:08.931] __func__ = "PerformWalRecovery" [06:40:08.931] #19 0x000055b0aa98cedf in StartupXLOG () at ../src/backend/access/transam/xlog.c:5723 [06:40:08.931] Insert = [06:40:08.931] checkPoint = {redo = 33554472, ThisTimeLineID = 1, PrevTimeLineID = 1, fullPageWrites = true, nextXid = {value = 739}, nextOid = 24576, nextMulti = 1, nextMultiOffset = 0, oldestXid = 730, oldestXidDB = 1, oldestMulti = 1, oldestMultiDB = 1, time = 1711694177, oldestCommitTsXid = 0, newestCommitTsXid = 0, oldestActiveXid = 739} [06:40:08.931] wasShutdown = false [06:40:08.931] didCrash = [06:40:08.931] haveTblspcMap = false [06:40:08.931] haveBackupLabel = false [06:40:08.931] EndOfLog = [06:40:08.931] EndOfLogTLI = [06:40:08.931] newTLI = [06:40:08.931] performedWalRecovery = [06:40:08.931] endOfRecoveryInfo = [06:40:08.931] abortedRecPtr = [06:40:08.931] missingContrecPtr = [06:40:08.931] oldestActiveXID = [06:40:08.931] promoted = false [06:40:08.931] __func__ = "StartupXLOG" [06:40:08.931] #20 0x000055b0aae44572 in StartupProcessMain (startup_data=, startup_data_len=) at ../src/backend/postmaster/startup.c:258 [06:40:08.931] No locals. [06:40:08.931] #21 0x000055b0aae3bd3c in postmaster_child_launch (child_type=child_type@entry=B_STARTUP, startup_data=startup_data@entry=0x0, startup_data_len=startup_data_len@entry=0, client_sock=client_sock@entry=0x0) at ../src/backend/postmaster/launch_backend.c:265 [06:40:08.931] pid = [06:40:08.931] #22 0x000055b0aae3dc07 in StartChildProcess (type=type@entry=B_STARTUP) at ../src/backend/postmaster/postmaster.c:3928 [06:40:08.931] pid = [06:40:08.931] __func__ = "StartChildProcess" [06:40:08.931] #23 0x000055b0aae43cd1 in PostmasterMain (argc=argc@entry=4, argv=argv@entry=0x55b0ad9f0df0) at ../src/backend/postmaster/postmaster.c:1364 [06:40:08.931] opt = [06:40:08.931] status = [06:40:08.931] userDoption = [06:40:08.931] listen_addr_saved = false [06:40:08.931] output_config_variable = [06:40:08.931] __func__ = "PostmasterMain" [06:40:08.931] #24 0x000055b0aac6c47a in main (argc=4, argv=0x55b0ad9f0df0) at ../src/backend/main/main.c:197 [06:40:08.931] do_check_root = [06:40:08.931] [06:40:08.931] Thread 1 (LWP 21339): [06:40:08.931] #0 0x00007f00337ebfc7 in sigprocmask () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.931] No symbol table info available. [06:40:08.931] #1 0x00007f003389d13a in ?? () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.931] No symbol table info available. [06:40:08.931] #2 0x00007f00338aea6f in clone () from /lib/x86_64-linux-gnu/libc.so.6 [06:40:08.931] No symbol table info available.