TrueNAS-SCALE-21.08-BETA.1 hang on install with nvme disks

Description

Trying to do a clean install of TrueNAS-SCALE-21.08-BETA.1 on PowerEdge Dell R7515, spec:

Dell R7515

  • AMD EPYC 7302P 16-Core Processor

  • 32GB ECC DDR4

  • PERC H730P in HBA mode

  • 3 x WD HC550 18GB SATA

  • BOSS-S1 2 x M.2 SATA

  • 2 x Micron 1300 M.2 SATA

  • Supermicro AOC-SLG3-2M2 2 x M.2 NVMe

  • XPG SX8200 512GB M.2 NVMe

  • Sabrent Rocket 512GB M.2 NVMe

  • 10Gtek NV95NF HBA card, PCIe x16 4 x M2 NVME

  • 1 x XPG SX8200 M.2 1TB NVMe

  • 3 x Sabrent Rocket 1TB M.2 NVMe

Install just hangs right after I select Install TrueNas option with black screen.

In same time I am able to install:

  • Windows 10

  • Fedora server 43

both of these can asee all disks fine.

For example, here is output from Fedora 34

[root@fedora ~]# lsblk -a -o KNAME,TYPE,SIZE,MODEL,ALIGNMENT,HCTL,WWN,VENDOR |grep -iE "disk|type"
KNAME TYPE SIZE MODEL ALIGNMENT HCTL WWN VENDOR
sda disk 238.5G MTFDDAV256TDL 0 0:0:0:0 0x500a075124f20e9e ATA
sdb disk 238.5G MTFDDAV256TDL 0 1:0:0:0 0x500a075124f809cc ATA
sdc disk 16.4T WDC_WUH721818ALE6L4 0 12:0:0:0 0x5000cca2c2c88971 ATA
sdd disk 16.4T WDC_WUH721818ALE6L4 0 12:0:1:0 0x5000cca2afe15ed9 ATA
sde disk 16.4T WDC_WUH721818ALE6L4 0 12:0:2:0 0x5000cca284d80d5e ATA
sdf disk 1.1T ST1200MM0099 0 12:0:9:0 0x5000c500cbc4271f SEAGATE
zram0 disk 8G 0
nvme0n1 disk 476.9G Sabrent 0 eui.6479a72fb1902fbd
nvme3n1 disk 953.9G Sabrent 0 eui.6479a72ef0011581
nvme4n1 disk 953.9G Sabrent 0 eui.6479a749205005fd
nvme5n1 disk 953.9G Sabrent 0 eui.6479a7492050066b
nvme2n1 disk 953.9G ADATA SX8200PNP 0 nvme.1cc1-324a35303230303238343032-414441544120535838323030504e50-00000001
nvme1n1 disk 476.9G ADATA SX8200PNP 0 nvme.1cc1-324b30373230303733393734-414441544120535838323030504e50-00000001

FreeBSD based TrueNAS-12.0-U5.1 seems like NOT being able to see Micron 1300 M.2 SSD (on Dell BOSS-S1 PICe adapter).

Problem/Justification

None

Impact

None

Activity

William Gryzbowski 
October 4, 2021 at 2:40 PM

Unfortunately we don't have the right hardware to reproduce so unless someone has a pointer on what to fix I will just close this for now.

Our hope is that this is a kernel issue and it will be fixed as soon as we updated to a newer upstream version (as new as the version the fedora you tested uses)

Dmitry 
October 4, 2021 at 4:53 AM

Thank you for checking , yes it could be closed.

Downgrading firmware on Dell BOSS-S1 to A03 (2.5.13.3011) - https://www.dell.com/support/home/en-us/drivers/driversdetails?driverid=rpd7y resolved the problem so far. Still probably worth to investigate why it does not cause any issues for Windows or Fedora (RHEL based Linux), but it's up to you.

William Gryzbowski 
October 1, 2021 at 7:25 PM

Am i understanding correctly that the firmware downgrade fixed the issue and this can be closed?

Dmitry 
September 30, 2021 at 11:07 PM

5 mins, 20 mins in other use case and couple hours in another try.

There is more development on this problem from my side. 

I was trying to go back and forth between TrueNAS Scale and TrueNAS Core 12.0-U5 and found a suggestion to downgrade firmware on BOSS-S1 adapter to A03, which enables TrueNAS Core 12.0-U5 to see M2 disks on that.

After I was able to install successfully TrueNAS Core 12.0-U5, it could not see my network dual port 10Gb card (BCM57416 NetXtreme-E Dual-Media 10G RDMA Ethernet Controller), so I have decided to give another try TrueNAS-SCALE-21.08-BETA.1 and it actually went through with install.

William Gryzbowski 
September 30, 2021 at 7:00 PM

Hangs forever? How long did you wait?

Cannot Reproduce

Details

Assignee

Reporter

Labels

Components

Fix versions

Affects versions

Priority

More fields

Katalon Platform

Created September 29, 2021 at 1:42 AM
Updated July 6, 2022 at 8:59 PM
Resolved October 4, 2021 at 2:40 PM