or Connect
AVS › AVS Forum › Video Components › Home Theater Computers › Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.!
New Posts  All Forums:Forum Nav:

Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.! - Page 69

post #2041 of 3346
Quote:
Originally Posted by nickbuol View Post

I hear you techmattr, but it has been posted previously that some people use FLAC for everything. Even a recently attached photo in this thread showed someone with a DTS-HD stream and using FLAC.


I understand your point completely and agree with it, but I am trying to understand others' logic to see if there is merit for what I am doing. So far it sounds like there isn't.

Sorry Nick, my photo did more harm than good. I was specifically addressing the idea of "another step" which when people hear "encoding" and "extra step" they typically assume that someone is running a rip in MakeMKV then passing it through Handbrake. Both are great software, but running rips through the second one takes a lot of excess time. I was simply trying to point out how simple the audio conversion is using just makemkv.

Unfortunately I went out to the internet and stole that image from a google search. I'm pretty sure they were running makemkv from a mac (which I've not yet ever owned) smile.gif I wasn't trying to indicate it was the way I rip everything, although I'm sure some do for reasons that you all have provided
post #2042 of 3346
@Dark_Slayer.

No worries. It got cleared up.

What is funny is that up until my post a few days back about what to do with a LPCM audio stream, I hadn't seen one in the 200 blu-ray rips that I had done. Now, all of a sudden, I am seeing it more and more. I think since then I have had 4 more. Three just tonight. I think that it might have to do with the age of the movies. These are some of my older blu-rays.

I am still just changing the setting via MKVmerge GUI since it takes a few seconds and seems to work fine.
post #2043 of 3346
Thread Starter 
How much storage have you used ?
post #2044 of 3346
Quote:
Originally Posted by Mfusick View Post

How much storage have you used ?

I started with 13.6TB usable I believe (Five 3TB drives plus a sixth one for parity) and I am down to about 7.2-7.5TB free still. Something like that. Oh, that used space also includes about 30 music albums (not much in comparison) and about 500GB of backup information from my primary desktop PC. I think that I am still averaging around 27.5GB per movie rip. Sure, some are bigger like Avatar at 38GB, and I want to say Titanic was silly big at 42GB ripped.
post #2045 of 3346
Thread Starter 
I am looking to buy a slim line BR drive for my server. Must fit into my Norco 4220 case- and must hook up to spare MOBO sata port.

Ideas?

I want cheap (think $30 or less)


What's my best option ?
post #2046 of 3346
i don't think that you will have such luck.. The slim line BR drives I was looking at when I was going to go for a small HTPC case were at least $90 for slot load, and $65 for tray load. Heck, how often do you see regular sized drives for less than $50? Not saying it doesn't happen... You know me. I am big on waiting for NewEgg, MicroCenter, etc to have a sale, but I don't recall seeing one for near that price.

Although, I haven't searched for one in a month or so.
post #2047 of 3346
Thread Starter 
I was thinking ebay used... $30

Just wondering what people thought about that ? Any compatibility issues ?
post #2048 of 3346
Thread Starter 
I posted this in Nick Buol's HTPC build thread as response to an issue he was having with 2 Disc movies like Lord of the Rings. It seems that MB3 no longer supports the "part1" and "part 2" feature like MB2 did. Gone is the check box that let you select to automatically play part 2 when part 1 ended. My collection was set up for MB2.6 and I simply had "part1" and "part 2" MKV movie files in the same movie folder.

I guess now you need to use seperate movie folders for each disc until that functionality is added back into the MB3 beta build (hopefully they will do it)

post from other thread below
Quote:
Originally Posted by nickbuol View Post

I see what you are saying...


Something like this:




If you make it a "box set" then you won't have items in your top level folders or library. You would only have the LOTR Trilogy folder. Once you enter it- I guess it does not matter if it has 6 folders or only 3 folders. Does it ??? They only show up if you are navigating inside the LOTR Trilogy collection, which you would likely only do if you wanted to watch one of them. Otherwise you just breeze right past the top level "trilogy collection" folder and everything stays neat in your browser.


I don't have my server online so I just used a small Dolby 7.1 Demo video I had (100MB) and stuck it in the folders. But I created a fake library real quick. I just used the same test video for each folder just to simulate the effect.

Here is the first folder I named it "NICK TEST AVS" but you probably would call it "BR rips" or something like that. Inside that I have a "Lord of the Rings Trilogy" folder mixed into a couple fake popular movies I created for effect. I converted that "LOTR TRILOGY" folder into a box set or into a nested folder.

Inside I have the 6 movie folders above - 3 movies each part 1 and part 2 for each of the 3 movies.




This is how I did it:

Top level folder I called "NICK TEST" [this would be your rips folder probably]


navigate inside you see some fake movies I made:


if you go inside the LOTR folder you have some view options:

poster view



List view:


Cover Flow view:



Then you just jump into the movie:


Assuming the above was "part 1' you would then exit when part 1 was over with "back" key on remote, enter the next one that is "part 2" and play.


Seems easy enough. biggrin.gif

Who cares if you have 6 folders and 2 for each movie, one for part 1 and one for part 2 ?? It's easier and probably safer to do it this way than try to MKV merge them and suffer audio sync issues. I would expect future version to include the feature like MB2.6 had where it will automatically play the second video file when the 1st movie finishes in a future build anyways. At that point you can just delete part 2 folder and move the part 2 MKV to the same folder as part 1.

end


So- Anyone else have some thoughts or suggestions ?? Anyone have better suggestion how to do it ???
post #2049 of 3346
How hard is it to break open a Seagate Backup Plus? Is it possible to put the drive back in once opened? I am thinking of buying one from Costco today.
post #2050 of 3346
Thread Starter 
Quote:
Originally Posted by amarshonarbangla View Post

How hard is it to break open a Seagate Backup Plus? Is it possible to put the drive back in once opened? I am thinking of buying one from Costco today.

There is two case versions. One of them is super easy and can go back together (snaps back together)

The other version is the one with the spindles of plasic- those are easy to open if you want to break it (never put back together) but you need to be careful and open from the corner if your intention is to re-use the case again.
post #2051 of 3346
Quote:
Originally Posted by Mfusick View Post

There is two case versions. One of them is super easy and can go back together (snaps back together)

The other version is the one with the spindles of plasic- those are easy to open if you want to break it (never put back together) but you need to be careful and open from the corner if your intention is to re-use the case again.

Oh boy. Is there any way to know beforehand which drive will contain the easy to open case?

Any good tuts for opening both the case versions?
post #2052 of 3346
Thread Starter 
There might be a youtube video but I usually just yank on them. It's just plastic held together with clips. lately Costco has had the version that is harder to open, while staples tends to have the easy case to open.
post #2053 of 3346
Quote:
Originally Posted by Puwaha View Post

Good points all above, but I still make the personal case that FlexRAID is not the best choice for that much data. I have personally outgrown FlexRAID but its a good choice if all you are protecting is mostly in hanging data like movie files. Like mention above don't forget the intel NIC. Other brands work just fine on a windows server based OS, but I typically only use those "other" brand NICs as a maintenance/service connection.

I'm just about to build a server/HTPC with about 8TB to start and capable of 20TB. What would you recommend instead of FlexRaid? Would prefer a windows solutions so I can run crashplan, UPS software, etc.
post #2054 of 3346
Quote:
Originally Posted by hdkhang View Post

I came to that same conclusion myself which is why I found the SuperMicro boards to be ideal (I bought mine for $180ish if memory serves). Featurewise I got 2 Intel NICs, ECC memory support, a good configuration of PCIe slots and IPMI!

IPMI is a feature that is a pre-requisite for any future server hardware (so tempting to try to have it on HTPC's as well smile.gif)

Can you share the model you bought? or an equivalent LGA1150
post #2055 of 3346
Quote:
Originally Posted by Mfusick View Post

There might be a youtube video but I usually just yank on them. It's just plastic held together with clips. lately Costco has had the version that is harder to open, while staples tends to have the easy case to open.

Opening it wasn't as bad as I thought. Testing the drive now with badblocks command before I put it in my machine.
post #2056 of 3346
Thread Starter 
Quote:
Originally Posted by amarshonarbangla View Post

Opening it wasn't as bad as I thought. Testing the drive now with badblocks command before I put it in my machine.

What's bad locks ?
post #2057 of 3346
Quote:
Originally Posted by Mfusick View Post

What's bad locks ?

A command in linux which tests for badblocks by writing 4 different patterns to every bit of the drive and reading it back to verify it. It's a good way to stress test the drive as well.
post #2058 of 3346
Quote:
Originally Posted by Mfusick View Post

I posted this in Nick Buol's HTPC build thread as response to an issue he was having with 2 Disc movies like Lord of the Rings. It seems that MB3 no longer supports the "part1" and "part 2" feature like MB2 did. Gone is the check box that let you select to automatically play part 2 when part 1 ended. My collection was set up for MB2.6 and I simply had "part1" and "part 2" MKV movie files in the same movie folder.

I guess now you need to use seperate movie folders for each disc until that functionality is added back into the MB3 beta build (hopefully they will do it)

post from other thread below
Something like this:




If you make it a "box set" then you won't have items in your top level folders or library. You would only have the LOTR Trilogy folder. Once you enter it- I guess it does not matter if it has 6 folders or only 3 folders. Does it ??? They only show up if you are navigating inside the LOTR Trilogy collection, which you would likely only do if you wanted to watch one of them. Otherwise you just breeze right past the top level "trilogy collection" folder and everything stays neat in your browser.


I don't have my server online so I just used a small Dolby 7.1 Demo video I had (100MB) and stuck it in the folders. But I created a fake library real quick. I just used the same test video for each folder just to simulate the effect.

Here is the first folder I named it "NICK TEST AVS" but you probably would call it "BR rips" or something like that. Inside that I have a "Lord of the Rings Trilogy" folder mixed into a couple fake popular movies I created for effect. I converted that "LOTR TRILOGY" folder into a box set or into a nested folder.

Inside I have the 6 movie folders above - 3 movies each part 1 and part 2 for each of the 3 movies.




This is how I did it:

Top level folder I called "NICK TEST" [this would be your rips folder probably]


navigate inside you see some fake movies I made:


if you go inside the LOTR folder you have some view options:

poster view



List view:


Cover Flow view:



Then you just jump into the movie:


Assuming the above was "part 1' you would then exit when part 1 was over with "back" key on remote, enter the next one that is "part 2" and play.


Seems easy enough. biggrin.gif

Who cares if you have 6 folders and 2 for each movie, one for part 1 and one for part 2 ?? It's easier and probably safer to do it this way than try to MKV merge them and suffer audio sync issues. I would expect future version to include the feature like MB2.6 had where it will automatically play the second video file when the 1st movie finishes in a future build anyways. At that point you can just delete part 2 folder and move the part 2 MKV to the same folder as part 1.

end


So- Anyone else have some thoughts or suggestions ?? Anyone have better suggestion how to do it ???
I just mux them together. No sync issues. Mine is encoded though. If you don't encode yours you can use tsmuxer to mux them.
post #2059 of 3346
Thread Starter 
Update:

So I had installed my old server SSD into my desktop to see if I could see it and I could not. I never unhooked it. After about a week I look over and see two hard drives on my system that I do not recognize. I click on one and see this:





It's my server drive !!!


It came back to life!!!


But then I installed it into my sever and turned it on, and it's gone again mad.gif



Any ideas?

I am basically about to install a new OS drive and start fresh again.... Just RMA this one and use the replacement as a backup.


I am also considering since I am starting fresh possibly trying FLEXRAID T instead of FLEXRAID F- what do you guys think ? Brahim offered to help me set it up, but I am just unsure if I want it or not. Thoughts?
post #2060 of 3346
Why is your used space so large? 65 GB seems like a lot.
post #2061 of 3346
Thread Starter 
That's pretty normal I think

I had nothing installed except mb3 and plex and only a few drivers I downloaded

I didn't have much software installed
post #2062 of 3346
Definitely not normal. A typical WHS2011 install only takes up aout 30~35GB. I've got a ton of stuff on my C: drive for both my WHS2011 machine and my Win7 server.

WHS2011


Win7
post #2063 of 3346
Quote:
Originally Posted by Mfusick View Post


I am also considering since I am starting fresh possibly trying FLEXRAID T instead of FLEXRAID F- what do you guys think ? Brahim offered to help me set it up, but I am just unsure if I want it or not. Thoughts?

Why?
post #2064 of 3346
Thread Starter 
He offered it to me. I'm considering it.
post #2065 of 3346
Quote:
Originally Posted by Mfusick View Post

He offered it to me. I'm considering it.

I'm turned off by the speed hit of -T. Also, my -F is working fine the way it is.
post #2066 of 3346
Yeah I saw a massive speed hit using tRAID. Transfer speeds are anywhere from 10 MB/s to 30 MB/s. Turning on OS caching ups it to 50-110 MB/s, but if the power goes out during the transfer, the data still in RAM may be lost. Also these are over network speeds, not local.
post #2067 of 3346
Quote:
Originally Posted by Mfusick View Post

That's pretty normal I think

I had nothing installed except mb3 and plex and only a few drivers I downloaded

I didn't have much software installed

My WHS2011 install with Flexraid and a couple of apps and addons installed is only 30.4gb.

David
post #2068 of 3346
Hey Mfusick, kindly do a favor for me. Look at some SMART data of some of your Seagate drives. Let me know what you see in the "Raw Read Error Rate", "Reallocated Sector Count" and "Current Pending Sector Count" fields.
post #2069 of 3346
Quote:
Originally Posted by Mfusick View Post

He offered it to me. I'm considering it.
Take the plunge already. biggrin.gif
It is well tested. It has been stable since earlier this year, but we spent more time fine tuning it.
With enough RAM, you will be pressed to notice any speed hit over RAID-F.
Quote:
Originally Posted by bryansj View Post

I'm turned off by the speed hit of -T. Also, my -F is working fine the way it is.
Transparent RAID (tRAID) is not necessarily better than RAID over File System (RAID-F). It is newer - yes. It covers more deployment scenarios - yes. Got some super cool real-time RAID features - yes. However, RAID-F's Snapshot feature remains king for static data. You just can't beat the flexibility. So, going to tRAID from RAID-F is not an upgrade but rather a migration. Both are relevant and address the problem a bit differently - and that's all there is to it.
So, if RAID-F works best for you as it should for many users on this forum, then I am more than pleased. smile.gif

It is certainly hard to shake off that "newer is better" thought.
Quote:
Originally Posted by rc05 View Post

Yeah I saw a massive speed hit using tRAID. Transfer speeds are anywhere from 10 MB/s to 30 MB/s. Turning on OS caching ups it to 50-110 MB/s, but if the power goes out during the transfer, the data still in RAM may be lost. Also these are over network speeds, not local.
I don't think you tuned it well enough in your setup. Everybody else is getting 50MB+ on TCQ and as fast as the source disk when OS Caching is on (so, 500MB+ possible).

The power going out with OS Caching should not be an issue. It will result in nothing more than an interrupted buffered transfer.

@Mfusick
Back to you, no question that Snapshot RAID might be the best choice for your particular needs, but I need a guinea pig real customer system for a series of video tutorials on tRAID. tongue.gif
It is rather easy to switch between tRAID and RAID-F. So, if tRAID proves less ideal, you can revert back to RAID-F. smile.gif
post #2070 of 3346
Quote:
Originally Posted by spectrumbx View Post

Take the plunge already. biggrin.gif

Hey brahim/spectrumbx,

I know you have a lot of pretty well doc'd info out there about tRAID, but can you do me a favor and answer my questions so I can be a lazy-good-for-nothing forum leech? smile.gif
  1. You can continually add disks to your tRAID pool, correct? (Not just replace for larger - as is the case with ZFS)
  2. When you mention the array is self-healing, what steps will it take during background scrubbing?
  3. What does tRAID do when my read error rate gets too high on a particular disk? Do you have some determination of a reasonable drive health to continue the array? Are the s.m.a.r.t. reports still just the raw data?
  4. For live data reconstruction, I need multiple parity discs correct? e.g. I have RAID-F on 1x4TB parity supporting 2x4TB and 4x3TB data disks. For live reconstruction, I'd need to add another 4TB disk correct?

Some other curiosities I have are pulling the drives. . . say I have my array with a tolerance of 2 disks and I pull one. How do I know what data is on that disk? Also, I can't really put the disk back in the array if it's been read by any OS correct? At least, it isn't safe to do so. If I had some desire to take a disk out of my array (with a tolerance of more than 1 disk) and copy it's info over to a different computer in some other location (outside my LAN - which would be the only logical reason for doing this), then I could wipe it and add it back to the array for restoration without screwing anything up?

Also, how long does live data reconstruction take if I lose one of the 3 or 4 TB drives?

Finally, does the initial parity calculation render my data unusable until it's complete?
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Home Theater Computers
AVS › AVS Forum › Video Components › Home Theater Computers › Mfusick's How to build an affordable 30TB Flexraid media server: Information Requested.!