Samba panic

Samba crashed this morning.  I wanted to attach smbd.core but it is too big (207,652 KB). I had freshly rebooted the system, then started backups from my PC to the server.

I tried to figure out what process/program PID 3535 (the one running at the time of the crash) was, but I don't know where that data is located.

Some random logfile biz:

Jan  3 11:05:33 FreeNas kernel: vnet0.8: promiscuous mode enabled
Jan  3 11:05:38 FreeNas kernel: lo0: link state changed to UP
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380714-07:00 FreeNas.LOLLAN nmbd 3230 - - [2021/01/03 11:08:16.380581,  0] ../../source3/nmbd/nmbd_become_lmb.c:397(become_local_master_stage2)
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380806-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380838-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380861-07:00 FreeNas.LOLLAN nmbd 3230 - -   Samba name server FREENASSMB is now a local master browser for workgroup LOLLAN on subnet 10.11.12.7
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380878-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380894-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380938-07:00 FreeNas.LOLLAN nmbd 3230 - - [2021/01/03 11:08:16.380920,  0] ../../source3/nmbd/nmbd_become_lmb.c:397(become_local_master_stage2)
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380957-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.380973-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381003-07:00 FreeNas.LOLLAN nmbd 3230 - -   Samba name server FREENASSMB is now a local master browser for workgroup LOLLAN on subnet 172.16.0.5
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381019-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381035-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381085-07:00 FreeNas.LOLLAN nmbd 3230 - - [2021/01/03 11:08:16.381067,  0] ../../source3/nmbd/nmbd_become_lmb.c:397(become_local_master_stage2)
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381103-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381119-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381137-07:00 FreeNas.LOLLAN nmbd 3230 - -   Samba name server FREENASSMB is now a local master browser for workgroup LOLLAN on subnet 172.16.0.1
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381153-07:00 FreeNas.LOLLAN nmbd 3230 - -   
Jan  3 11:08:16 FreeNas 1 2021-01-03T11:08:16.381170-07:00 FreeNas.LOLLAN nmbd 3230 - -   *****
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210057-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.209960,  0] ../../lib/util/fault.c:79(fault_report)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210137-07:00 FreeNas.LOLLAN smbd 3535 - -   ===============================================================
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210162-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.210146,  0] ../../lib/util/fault.c:80(fault_report)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210185-07:00 FreeNas.LOLLAN smbd 3535 - -   INTERNAL ERROR: Signal 11 in pid 3535 (4.12.9)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210227-07:00 FreeNas.LOLLAN smbd 3535 - -   If you are running a recent Samba version, and if you think this problem is not yet fixed in the latest versions, please consider reporting this bug, see https://wiki.samba.org/index.php/Bug_Reporting
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210249-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.210234,  0] ../../lib/util/fault.c:86(fault_report)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210268-07:00 FreeNas.LOLLAN smbd 3535 - -   ===============================================================
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210289-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.210275,  0] ../../source3/lib/util.c:830(smb_panic_s3)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.210308-07:00 FreeNas.LOLLAN smbd 3535 - -   PANIC (pid 3535): internal error
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.212878-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.212842,  0] ../../lib/util/fault.c:265(log_stack_trace)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.212918-07:00 FreeNas.LOLLAN smbd 3535 - -   BACKTRACE: 6 stack frames:
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.212968-07:00 FreeNas.LOLLAN smbd 3535 - -    #0 0x801296217 <log_stack_trace+0x37> at /usr/local/lib/samba4/libsamba-util.so.0
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.212998-07:00 FreeNas.LOLLAN smbd 3535 - -    #1 0x802f9b656 <smb_panic_s3+0x56> at /usr/local/lib/samba4/libsmbconf.so.0
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213026-07:00 FreeNas.LOLLAN smbd 3535 - -    #2 0x801296007 <smb_panic+0x17> at /usr/local/lib/samba4/libsamba-util.so.0
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213055-07:00 FreeNas.LOLLAN smbd 3535 - -    #3 0x8012963ee <log_stack_trace+0x20e> at /usr/local/lib/samba4/libsamba-util.so.0
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213082-07:00 FreeNas.LOLLAN smbd 3535 - -    #4 0x801295fe9 <fault_setup+0x59> at /usr/local/lib/samba4/libsamba-util.so.0
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213108-07:00 FreeNas.LOLLAN smbd 3535 - -    #5 0x8099dbc20 <_pthread_sigmask+0x530> at /lib/libthr.so.3
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213225-07:00 FreeNas.LOLLAN smbd 3535 - - [2021/01/03 11:18:46.213197,  0] ../../source3/lib/dumpcore.c:315(dump_core)
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213275-07:00 FreeNas.LOLLAN smbd 3535 - -   dumping core in /var/db/system/cores
Jan  3 11:18:46 FreeNas 1 2021-01-03T11:18:46.213292-07:00 FreeNas.LOLLAN smbd 3535 - -
Jan  3 11:18:46 FreeNas kernel: pid 3535 (smbd), jid 0, uid 0: exited on signal 6

last pid: 13958;  load averages:  5.59,  5.81,  7.05    up 0+02:00:45  12:59:53
132 processes: 3 running, 129 sleeping
CPU:  1.2% user,  0.0% nice, 32.5% system,  0.2% interrupt, 66.1% idle
Mem: 4594M Active, 3837M Inact, 74G Wired, 11G Free
ARC: 60G Total, 9842M MFU, 48G MRU, 127M Anon, 529M Header, 2431M Other
     54G Compressed, 74G Uncompressed, 1.36:1 Ratio
Swap: 10G Total, 10G Free

  PID USERNAME    THR PRI NICE   SIZE    RES STATE    C   TIME    WCPU COMMAND
 9707 root          1  99    0   228M   204M CPU15   15  64:46  90.19% smbd
 8553 root         19  20    0  3796M  3687M select  23  17:05  18.03% qbittorr
 8534 root          1  25    0    17M  7252K select  13  11:36   9.93% openvpn
  954 root         37  20    0  1716M  1425M kqread  10   4:04   0.97% python3.
 5662 root          2  20    0    32M    26M select   3   1:07   0.93% python3.
 8491    972       13  52   15   123M    59M piperd   5   0:19   0.17% Plex Scr
13941 root          1  20    0    14M  4232K CPU20   20   0:00   0.15% top
 8000    972       22  20    0   329M   148M uwait   16   0:50   0.10% Plex Med
 9172    471       29  21    0   855M    88M uwait   11   0:04   0.05% vault
 4101 root          2  20    0    28M    10M kqread   2   0:02   0.05% syslog-n
 7395     88       38  38    0  1784M   375M select   4   0:03   0.04% mysqld
 
2021/01/02 22:48:12.561718,  0] ../../lib/util/become_daemon.c:136(daemon_ready)
  daemon_ready: daemon 'smbd' finished starting up and ready to serve connections
[2021/01/03 11:02:53.465630,  0] ../../source3/smbd/server.c:1782(main)
  smbd version 4.12.9 started.
  Copyright Andrew Tridgell and the Samba Team 1992-2020
[2021/01/03 11:02:54.017679,  0] ../../source3/smbd/server.c:1782(main)
  smbd version 4.12.9 started.
  Copyright Andrew Tridgell and the Samba Team 1992-2020
[2021/01/03 11:02:54.026808,  0] ../../lib/util/pidfile.c:197(pidfile_create)
  ERROR: smbd is already running. File /var/run/samba4/smbd.pid exists and process id 3238 is running.
[2021/01/03 11:02:54.203591,  0] ../../lib/util/become_daemon.c:136(daemon_ready)
  daemon_ready: daemon 'smbd' finished starting up and ready to serve connections
[2021/01/03 11:18:46.209960,  0] ../../lib/util/fault.c:79(fault_report)
  ===============================================================
[2021/01/03 11:18:46.210146,  0] ../../lib/util/fault.c:80(fault_report)
  INTERNAL ERROR: Signal 11 in pid 3535 (4.12.9)
  If you are running a recent Samba version, and if you think this problem is not yet fixed in the latest versions, please consider reporting this bug, see https://wiki.samba.org/index.php/Bug_Reporting
[2021/01/03 11:18:46.210234,  0] ../../lib/util/fault.c:86(fault_report)
  ===============================================================
[2021/01/03 11:18:46.210275,  0] ../../source3/lib/util.c:830(smb_panic_s3)
  PANIC (pid 3535): internal error
[2021/01/03 11:18:46.212842,  0] ../../lib/util/fault.c:265(log_stack_trace)
  BACKTRACE: 6 stack frames:
   #0 0x801296217 <log_stack_trace+0x37> at /usr/local/lib/samba4/libsamba-util.so.0
   #1 0x802f9b656 <smb_panic_s3+0x56> at /usr/local/lib/samba4/libsmbconf.so.0
   #2 0x801296007 <smb_panic+0x17> at /usr/local/lib/samba4/libsamba-util.so.0
   #3 0x8012963ee <log_stack_trace+0x20e> at /usr/local/lib/samba4/libsamba-util.so.0
   #4 0x801295fe9 <fault_setup+0x59> at /usr/local/lib/samba4/libsamba-util.so.0
   #5 0x8099dbc20 <_pthread_sigmask+0x530> at /lib/libthr.so.3
[2021/01/03 11:18:46.213197,  0] ../../source3/lib/dumpcore.c:315(dump_core)
  dumping core in /var/db/system/cores