From practicalzfs.com
3 3
Many of the Linux Root-on-ZFS recipes make use of minimal network installers such as debootstrap. For distros that use Systemd, there are a couple of things related to the Systemd journal that can cause problems with logging. The journal is not persistent by default By default, systemd-journald...
19h ago
From practicalzfs.com
ZFS backup target (like rsync.net)
0 2
Any one know of other services that support native zfs send/recive? I know of rsync.net, but their minimum of 5TB is a bit much for my needs. And zfs.rent do not have a register page, and have not responded to my emails. any other alternatives i could look at? (i have read through this post...
on Tue, 11PM
From practicalzfs.com
Another NVMe mirror raid question
0 2
Somewhat related to Model recommendation for nvme mirror disks … I have a very similar use case to @SinisterPisces (want mirror config for VMs, FreeBSD 14.x) but am trying to select a server motherboard that hosts multiple NVMe v3/4/5. However, most commonly the interfaces supported on a given...
on Tue, 11PM
From practicalzfs.com
0 2
My apologies if this post is too offtopic - please let me know and I will delete it! I have gotten a notification from my web hosting provider with yet another price increase. So I figure it is time to start looking for another solution. For my websites I will be looking into hosting them on a...
on Mon, 6PM
From practicalzfs.com
ZFS send / recv bookmarks not sent
0 2
I am using ZFS send/recv – as part of my script – to send datasets from main server to backup server weekly (manual process). Since bookmarks were mentioned on the podcast, I have changed the script to support bookmarks instead, which has been great because I am now able to remove old snapshots...
on Mon, 3PM
From practicalzfs.com
Prevent data decryption on pulling backup server
0 2
Hi, please excuse me if such scenario was already discussed. I was wondering how to ensure that syncoid, running in pull mode at backup-server, doesn’t have any chance to decrypt data from its target backup-target, even if backup-server is compromised (root account is accessible to malicious...
on Mon, 2PM
From practicalzfs.com
0 2
G’day, I was just wondering what your experiences are like with ZFS in low ram environments? I need to run the nextcloud snap on a machine with 12GB of ram. I ideally would like to run this on a Ubuntu host with a Ubuntu VM stored on a ZFS pool. I don’t care about the safety of my data at all...
on Sat, 12PM
From practicalzfs.com
Ttech, creator of Proxmox VE Helper-Scrips has passed
0 0
I came across the news on Reddit and GitHub. Hadn’t seen it posted here, so figured I would drop a link to the GitHub update from his wife. I discovered these scripts a while back, and have been using them religiously ever since. These taught me so much about Proxmox as a whole, and how lxc’s...
on Nov 14
From practicalzfs.com
Cannot destroy a pool (not mounted, not scrubbing)
0 0
Why would doing zpool destroy come back with “pool is busy” when there is nothing mounted and no scrub operation. I’d like to blast the pool and start over (renaming it) but nothing I do seems to work. I’ve run iostat on the device and nothing is accessing it. Any help appreciated. Running...
on Nov 10
From practicalzfs.com
Fast Dedup, tested and reviewed
0 0
Hi folks–Klara Systems was kind enough to give me the chance to personally test and review the new fast dedup code which will be available in OpenZFS soon. (I used a provided pair of packages to install it onto FreeBSD 14.1, which does not include fast dedup by default.) If you’ve ever been...
on Nov 7
From practicalzfs.com
0 0
Here’s a snapshot of iostat during a scrub of my rustpool: 4x SATA drives in two mirror vdevs. The numbers jump around a bit but I’m seeing rMB/s remain over 100 per drive for many minutes at a time. As depicted here the sum is 608MB/s and it’s exactly what I expect from this pool. To me...
on Nov 5
From practicalzfs.com
Disaster recovery for zfs on root?
0 0
Hi, I have found my self wondering what the best practice is to create a disaster recovery for a zroot pool. Is it possible to create a disaster recovery backup for a hardware failure with built-in zfs tools to backup an entire pool or should I consider tools that creates a full disk copy...
on Oct 31
From practicalzfs.com
Corruption in a missing snapshot?
0 0
Zpool status -v ends with: errors: Permanent errors have been detected in the following files: <0xb38a>:<0x80> Is there a way to clear this? I believe it’s pointing into a deleted snapshot.
on Oct 31
From practicalzfs.com
Raidz2 size with odd sized drives
0 0
I am now on phase two of shifting my data around and just created a 6 disk Raidz2 out of 1 x 1 TB, 1 x 2 TB, 2 x 3 TB, and 2 x 4 TB drives. I was expecting to get 3.6 TB pool size, but it comes out 5.45 TB?
on Oct 30
From practicalzfs.com
0 0
So. Probably, like many others here, I have been hoarding quite the amount of data over the course of the years. However, it’s only in the later years I’ve been doing it in an organized way (I used to just throw stuff on external HDDs earlier) since, when I was a youngster, I just thought I’d...
on Oct 29
From practicalzfs.com
Zfs dataset error when running sanoid
0 0
@mercenary_sysadmin Just wanted to make you aware of this issue which is causing zfs to show errors.
on Oct 29
From practicalzfs.com
Error syncing some datasets: "Invalid argument" from zfs send
0 0
When trying to sync some datasets, syncoid fails because zfs send fails with the error “Invalid argument”. Example: # zfs snapshot revivajxo2/scott/Videos@`date -I` # zfs send -w revivajxo2/scott/Videos@`date -I` | mbuffer -q -s 128k -m 16M | pv -pterb | zfs receive -s -F...
on Oct 29
From practicalzfs.com
0 0
Discuss OpenZFS itself here—command line warriors, this is your place to shine!
on Oct 29
From practicalzfs.com
0 0
Hello Proxmox folks! This forum is a part of the general exodus from Reddit due to user-hostile management decisions in 2023–when r/zfs packed up and left, we invited r/proxmox to come with us since Proxmox users are generally <em>de facto</em> OpenZFS users.
on Oct 29
From practicalzfs.com
Problems with zfs send/receive: destination [...] has been modified since most recent snapshot
0 0
I was debating whether to post this in <span class="hashtag-icon-placeholder"></span>Proxmox</span> or <span class="hashtag-icon-placeholder"></span>OpenZFS</span> - it ended here - please move it to proxmox instead 🙂 I am in the process of setting up my hyperconverged proxmox/storage box. I...
on Oct 29
From practicalzfs.com
0 0
I have a curious problem, where free space is just missing on my pool. Host OS is Fedora 40. ZFS packages are in version 2.2.6-1. There is a VM running on that host that has some directories on that pool mounted through virtiofs. I also replicate datasets to external drives and a remote box,...
on Oct 28
From practicalzfs.com
I want Hardwaresuggestion and Best Practices for OpenZFS Setup
0 0
Hey everyone, I have got a pretty basic setup at home right now & I am planning to expand it. I am thinking about setting up a NAS with OpenZFS and wanted to know what hardware you all suggestion for a beginner. I am curious about what kind of CPU and RAM I should be looking at. Also are there...
on Oct 28
From practicalzfs.com
Curious as to the utility of ZFS bookmarks
0 2
When I heard Alan mention ZFS bookmarks on the latest 2.5 Admins I went looking on the OpenZFS documentation as this was not a feature I had previously been aware of, and I must admit I don’t know if my understanding is correct. I also found this post which I think clarified the use of these a...
on Oct 25
From practicalzfs.com
Syncoid Pull from TrueNAS Scale fails
0 0
Hey All I’m trying to pull snapshots from a TrueNAS Scale box to an Alma Linux 9 box with a simple script I wrote that calls syncoid. I’ve used the script before for TrueNAS Core and Alma 8 with no issues. Sanoid/syncoid have been installed on the NAS. This time around I seem to have three...
on Oct 22
From practicalzfs.com
[Tutorial] Proxmox-NUT Homelab HOWTO - Step 6 : Update Debian / Snapshots / Upgrade VirtIO
0 0
A new step has been added to the series. It covers Debian and Proxmox manual updates, Snapshots, Storage and Snapshots, Snapshots vs Backups and Upgrading VirtIO. The VMWare image that accompanies this series has been updated to take into account this step. You can download the torrent from...
on Oct 22
From practicalzfs.com
Home Lab HowTo Step 3 : Install Win Srv 2022 / Configure Shutdown from Proxmox/QEMU
0 0
The third part of a seven part series that explores Proxmox. from installation through setting up a NUT-based UPS solution. This module installed a Windows server and configures it to be controlled from Proxmox. https://youtu.be/O8BGpyc6XzM A torrent of the VMWare images this series is based...
on Oct 20
From practicalzfs.com
How to get a count of the different recordsizes on a zpool
0 0
Does anyone know how to get a count of how many records on a volume are 1M vs 128K vs 64K etc? It would be nice to know to help calculate dedup efficiency.
on Oct 18
From practicalzfs.com
Proxmox - ZFS - NFS - SMB hyper convergence?
0 0
Initial upgrade plans: Separate fileserver and Hypervisor(s) So I got the final bits and bobs for my fileserver upgrade yesterday. As you may recall from my previous post in the TrueNAS category I was planning to keep file server and hypervisor seperate as they are now. But during the waiting...
on Oct 18
From practicalzfs.com
Any adjustments for read-ahead strategy?
0 0
I have a corner-case where what should be a steady, long, sequential big-block file read is actually a mixed smallish blocksize schizophrenic chopfest. The devs have no interest in fixing this because reasons. After examining a Procmon capture I’m fairly confident if the filesystem’s...
on Oct 17
From practicalzfs.com
New OpenZFS feature: Block Reference Table
0 0
Today my article on the new OpenZFS Block Reference Table went live at Klara Systems. This new feature allows for file-level reuse of blocks, not just dataset-level! It can be a game-changer, but there are some caveats. Read on:
on Oct 10
From practicalzfs.com
Syncoid option for 2 production servers and 1 backup server
0 0
Hello, I have 3 servers; A,B and C. Server A and B are production servers while C is a purely a backup server. Both A and B have sanoid running on them. Every night server A and B transfer their datasets to each other. The syncoid commands are always initiated from server A like so #syncoid...
on Oct 9
From practicalzfs.com
To partition or not to partition?
0 0
I’m very new to ZFS, so bear with me as my wording may be incorrect… I have 3x 6TB drives and 4x 10TB drives that I would like to make full use of under ZFS. Any reason I couldn’t use a layout like below where the 10TB drives are partitioned into a mix of 6TB and 4TB? Once partitioned, could I...
on Oct 5
From practicalzfs.com
To l2arc_mfuonly or not to l2arc_mfuonly?
0 0
My ZFS is exclusively for block (excepting the local OS which runs nothing significant). All ZVOL + iSCSI over 10Gb network. 4x slow rust and a small Optane LOG + CACHE. The storage is used thusly: VMware + Microsoft lab: General purpose VMs with no substantial data ingestion/egress. Not...
on Oct 4
From practicalzfs.com
Upgrade path for a fileserver/NAS
0 0
I am running a TrueNAS Scale for my fileserver needs. It is an old desktop machine with the following configuration: ASUS Z97 Motherboard 1 m.2 slot + 6 SATA ports (not sure all 7 can be used at the same time) Realtek onboard 1000base-T NIC Intel i5-4440 12 GBs of RAM (2 x 2 GB + 2 x 4 GB) ...
on Oct 4
From practicalzfs.com
FYI FWIW - Building zfsbootmenu with remote SSH access and ZFS version 2.2.6
0 0
Thanks to @Halfwalker sharing his excellent Ubuntu build script, I was finally able to figure out a local build of zfsbootmenu so that I could have the latest debian-packaged zfs and remote ssh access during boot. I thought I would share my notes in case it helps anyone else working on this type...
on Oct 1
From practicalzfs.com
Zpool mirror seems to have lost all data?
0 0
Hi all, This morning I found my server unresponsive (a NixOS install with Gnome, because I sometimes use it as a desktop). It’s likely that leaving Firefox with many tabs open somehow filled the memory and it ground to a halt. I hard to hard-reset the server, when it came back online I found...
on Oct 1
From practicalzfs.com
Sanoid monitoring bash script advice
0 0
I’m using sanoid and syncoid to make snapshots and sync them to backup pools. I want to monitor those snapshots and I see that sanoid has built in monitoring functions that work with nagios. I’m using healthchecks.io to monitor most of my homelab. So I wrote this bash script to monitor my pools...
on Oct 1
From practicalzfs.com
Promote OS updates and configuration changes to production using zfs send?
0 0
I would like a way to perform system updates and configuration changes on a test/staging machine, check everything is ok, then deploy those changes verbatim to a running production machine that has a read-only root dataset. The machine is servicing web requests. My current idea is to have my...
on Sep 27
From practicalzfs.com
Should I use separate datasets for each person in this scenario?
0 0
I’m going to have two servers, which are Lenovo M700 or M720q each with one or two internal NVMEs for Proxmox and VMs/LXCs, and a single 16TB USB HDD for data. I might use two HDD in a mirror on my main server just for a bit of redundancy and automatic error correction, and just have one on the...
on Sep 26
From practicalzfs.com
Experience with remote unlock of ZFS encrypted pools
0 0
Like everyone, I want to automate as much as I can. Including automated spin up of encrypted pools. Sometimes I have a power outage that lasts longer than my battery backups allow. My servers shut down, and then boot back up, after power is restored. I have native encrypted pools that I would...
on Sep 26
From practicalzfs.com
0 0
Hello, I use syncoid to raw send encrypted datasets to an off site backup via a push. Like many others, this causes my source server to kernel panic and have corruption in the local snapshots. I have observed that if I switch to a “pull mode” IE the off-site target initiates the backup, my...
on Sep 25
From practicalzfs.com
LSI/Broadcom 9300 vs 9400 vs 9500
0 0
I have a fileserver running TrueNAS scale which currently hosts my files. It is an old desktop motherboard (4th gen i3) using a mix of the onboard SATA ports and a single onboard NVMe (for boot). I am contemplating to expand this server with an HBA. I can see that LSI-9300 boards have been...
on Sep 24
From practicalzfs.com
[Solved] Importing pools with unsupported features - is that possible?
0 0
I have been debaring whether to post this in Proxmox or OpenZFS but I finally decided to post in OpenZFS - my apologies if Proxmox is a better fit. I have a ZFS pool made up of 2 spinning rust drives in a mirror. They have been running in a Proxmox server until I pulled them out from there -...
on Sep 24
From practicalzfs.com
Filesystem order as given by "zfs list"
0 0
I wonder about the filesystem order as given by “zfs list”, for scripting purposes. It seems to be alphabetical and hierarchical, but is that guaranteed? The man page describes the “-s” parameters, but ends with this paragraph: “If no sorting options are specified the existing behavior of zfs...
on Sep 22
From practicalzfs.com
0 0
I have a dataset which has near-constant low IOPS writes (50 IOPS/disk right now). If I am willing to forego some safety in this dataset, can I force it to buffer a certain amount of data/IOPS before committing to disk? I want fewer, bigger writes to my disk, but I don’t want to impact any...
on Sep 21
From practicalzfs.com
Using ZFS as an iSCSI Target for Mac OS: Volbocksize and Recordsize?
0 0
Hello! I’d like to experiment with setting up an iSCSI target on a TrueNAS server to use as storage for a modern Mac OS production system. Mac OS’ APFS file system fairly confusing when it comes to understanding how it works and how Mac OS uses it; I have no idea how to set the volblocksize. ...
on Sep 20
From practicalzfs.com
0 1
Hello, My TrueNAS server has one PCIe 4.0x4 slot. I don’t think it supports bifurcation, though I need to confirm that. I found this PCIe 3.0x4 card with a PCIe switch on board, which holds 2 NVMEs. https://www.amazon.com/gp/product/B0BCFZQZLR/ref=ox_sc_saved_image_2?smid=A36DOQ8QSJXCYP&psc=1 ...
on Sep 19
From practicalzfs.com
Recommendations for ZFS as NAS for Proxmox cluster
0 0
Hi, I plan to deploy a Ubuntu 24.04 server with 6x1TB SAS SSD and 12x2TB HDD as a dedicated storage server for 3 or 4 other servers running a Proxmox cluster. The server has 2x12-core CPUs and 192GB DDR4 RAM and will only be used as storage server. I want to store the VM disks on this server...
on Sep 16
From practicalzfs.com
Mirror pool expansion -- opinions sought
0 0
TL;DR: I have a mirror vdev; what would you do to expand this. 💾 I have x2 4 TB hard drives in a mirror, which is 54% full. I am planning for the future so have time to consider and take advice. Once my pool gets to 85% (could take 2-3 years) what would be best. This sever is turned on once a...
on Sep 11