I am thinking of extending my storage and I don’t know if I should buy a JBOD (my current solution) or a RAID capable enclosure.
My “server” is just a small intel nuc with an 8th gen i3. I am happy with the performance, but that might be impacted by a bigger software RAID setup. My current storage setup is a 4-bay JBOD with 4TB drives in RAID 5. And I am thinking of going to 6 x 8TB drives with RAID 6 which will probably be more work for my little CPU
Normally I would say software, or rather a raid-like filesystem like btrfs or ZFS. But in your specific case of funneleing it all through a single usb-c connection it is probably better to keep using an external box that handles it all internally.
That said, the CPU load of software raid it very small, so that isn’t really something to be concerned with, but usb connections are quite unstable and not good for directly connecting drives in a raid.
I mean I’ve been running the setup this way for >4 years and never had any problem with the USB connection, so I cannot attest to “usb connections are quite unstable”…
I supposed that is because the JBOD box was handling the raid internally so short connection issues are not that problematic and can be recovered from automatically. But that wouldn’t be the case if you connected everything together with a usb hub and usb to sata adapters and run a software raid on that.
I don’t know usb c in thunderbolt has direct access to pcie lanes.
I’ve been running a 4-disk RAIDz1 on USB for 4 years now with zero failures on one machine and one failure on another where it turned out the USB controller in one WD Elements was overheating. Adhering a small heatsink on it resolved the problem and it’s been stable under load for 2 years now. The USB devices have to be decent. AMD’s host controllers are okay. VIA hubs are okay. ASMedia USB-to-SATA are okay. I’m using some enclosures with ASMedia and some off-the-shelf WD Elements that also use ASMedia. It’s likely easier to get a reliable system if installing disks internally as the PSU and interconnects are much more regulated and any would work well, whereas with USB you have to be careful in selecting decent components.
USB hub.
Don’t do a RAID enclosure, just get one that exposes the disks straight to the OS.
Problem for me is: there is not a 6 bay enclosure and the 8 bay enclosures cost as many as a RAID capable one
I’d pay more money for a non raid enclosure.
I just set up my icy box drive bay with software raid. Works great, just remember in some cases you have to disable UAS for the enclosure
I read somewhere, years ago, that RAID6 takes about 2 cores, on a working server.
That may have been a decade ago, and hardware’s improved significantly since then.
Bet on 1 core being saturated, min, with heavy use of a RAID6 or Z2 array, I suspect…
I’d go with software raid, not hardware: with hardware RAID, a dead array, due to a dead controller-card, means you need EXACTLY the same card, possibly the same firmware-revision, to be able to recover the RAID.
With mdadm, that simply isn’t a problem: mdadm can always understand mdadm RAID’s.
_ /\ _
My guy Wendell says that Hardware Raid is Dead and is a Bad ldea in 2022
He also made a follow up video a few days ago:
Here is an alternative Piped link(s):
https://www.piped.video/watch?v=Q_JOtEBFHDs
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I’m open-source; check me out at GitHub.
There is an even more relevant video of using external storage trough USB. He recommends using software raid:
Here is an alternative Piped link(s):
https://piped.video/GmQdlLCw-5k?feature=shared&t=697
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I’m open-source; check me out at GitHub.
Very informative, thank you :)
Here is an alternative Piped link(s):
https://www.piped.video/watch?v=l55GfAwa8RI
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I’m open-source; check me out at GitHub.
Software, software, software! ZFS, mdraid, etc. USB is fine even with hubs, so long as your hubs and USB controllers (USB-to-SATA) are decent and not overheating.
ZFS kicks arse. It’s worth learning enough to get a basic array going, with a couple of datasets and encryption. Once you get acquainted with that, you’ll be using it for years to come.
Since hardware RAID is not state of the art anymore I will definetly stick with software RAID. I think I will just build a new server for the money, since an 8-Bay USB enclosure costs around 600€ and for that amount of money I can just build a new server with even better performance
While you’re at it you can get a PC case with plenty of drive slots… Check out Fractal Design.
Thats what I will be going for 😁
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters LVM (Linux) Logical Volume Manager for filesystem mapping NAS Network-Attached Storage NUC Next Unit of Computing brand of Intel small computers PCIe Peripheral Component Interconnect Express PSU Power Supply Unit RAID Redundant Array of Independent Disks for mass storage SAN Storage Area Network SATA Serial AT Attachment interface for mass storage ZFS Solaris/Linux filesystem focusing on data integrity
[Thread #495 for this sub, first seen 8th Feb 2024, 12:25] [FAQ] [Full list] [Contact] [Source code]
Your CPU should support vfio so you could pass though a PCIe sata controller to Truenas
How are those disks/the box connected to the NUC?
USB-C. It only has a single SATA connector inside
just my 2 cents, if youre going to do raid, buy a thing that will do it…
a nas or enclosure where the hardware does all the heavy lifting. do not build raided system from a bunch of disks… i have had, and have had friends have many failures over the years from those home brew raids failing in one way or another and its usually the software that causes the raid to go sideways… mayvbe shits better today than it was 10-20 years ago.
its just off my list. i bought a bunch of cheap nas devices that handle the raid, and then i mirror those devices for redundancy.
Y’all must be doing something wrong because HW raid has been hot garbage for at least 20years. I’ve been using software raid (mdadm, ZFS) since before 2000 and have never had a problem that could be attributed to the software raid itself, while I’ve had all kinds of horrible things go wrong with HW raid. And that holds true not just at home but professionally with enterprise level systems as a SysAdmin.
With the exception of the (now rare) bare metal windows server, or the most basic boot drive mirroring for VMware (with important datastores on NAS/SAN which are using software raid underneath, with at most some limited HW assisted accelerators) , hardly anyone has trusted hardware raid for decades.
deleted by creator
Y’all must’ve been doing something wrong with your hardware raid to have so many problems. Anecdotally, as an admin for 20+ years, I’ve never had a significant issue with hardware raid. The exception might be the Sun 3500 arrays. Those were such a problem and we had dozens of them.
So what were you doing wrong to have so much trouble with the Sun 3500’s?
[deleted]
