10/28 I just built a terrabyte raid server using linux. The distro is
an older version of RH 8 (need it to keep compatibility with certain
apps). I formatted the raid to be XFS. The server is an NFS server,
and I appear to be hitting the 2 gig file limit. According to the
docs I'm supposed to be able to get beyond the 2 gig limit with
RH8. I have compiled a new 2.4.27 kernel to replace the stock
RH8 kernel to be sure. Is this perhaps a limitation of the NFS
server? How can I tell and do I just need to recompile the
NFS utils and server? Isn't the server somehow integrated with
the kernel now? Or is this a limitation of the filesystem? -williamc
\_ I have no problem using ext3 and NFS with the 2.4.20-30.8
kernel. My guess is your filesystem. Does it have a largefiles
option? (I'm not familiar with xfs except on SGI.)
\_ Well, it should. XFS is supposed to handle large files
rather well. Other than dumping a 2+ gig file on the drive
is there a way to tell if the underlying filesystem supports
2+ gigs? I also heard that there may be libc issues. What
libc version are you using?
\_ The question is "Does it by default?". What's wrong with
dumping a 2+ gig file to the drive? That will provide your
answer. I am using glibc-2.3.2-4.80.6, if it matters.
\_ The fact that it's two gigs? Why apply hammer if you
can just figure it out by some setting? -williamc
\_ Are you having trouble with a particular application? does dd
create a file that large? I've had some problems with some
applications that don't deal with the largeness correctly (apache,
squid)
\_ I'm having trouble with it in general. I would like it to work
with NFS. The applications run on Sun machines, so no
2 gig barrier on the apps. -williamc
\_ I would stay away from XFS if you care about your data. The XFS
fsck code will corrupt your data if you lose power during a
journal replay. This can happen if you crash due to a power failure,
the power comes back on, you start the recovery, and the power
fails again. We just did a paper on this:
http://keeda.stanford.edu/~junfeng/papers/osdi04.pdf
--twohey.
\_ And ext3 or reiserfs is better? -williamc
\_ And ext3 or reiserfs is better? BTW, I read your paper,
you guys didn't test XFS... -williamc
\-i have not throughly read this over (yet) but any plans
to look at non-linux (AssOS) filesystems? I've been so
frustrated with linux i couldnt bring myself to participate
in this thread. ObAndrewHumeonAssOS |