The Glade 4.0

"Turn the lights down, the party just got wilder."
It is currently Sun Nov 24, 2024 4:51 am

All times are UTC - 6 hours [ DST ]




Post new topic Reply to topic  [ 10 posts ] 
Author Message
PostPosted: Sun Aug 25, 2013 11:39 am 
Offline
Oberon's Playground
User avatar

Joined: Thu Sep 03, 2009 9:11 am
Posts: 9449
Location: Your Dreams
This is just out of curiosity, I have already fixed the problem, but how it happened is mind boggling to me, and I hate not solving a mystery.

I have a networked hard drive box. Small, cheap, Linux-based EXT formatted DLink box with a lousy 4 TB of drive space on two drives (which I've set up in RAID-1 for redundancy, so 2TB working space) that I store my media on.

In my music folders, I've ripped all my old CDs (and those few I still buy). I have all of Sarah McLachlan's CDs, and the other day, I discovered that all the songs ripped from just one of those CDs (Fumbling Towards Ecstacy) were corrupted, and while still the correct file length, played for all of 2 seconds each, making little electronic noise while they did, but nothing recognizable. All the other songs are fine.

I'd blame the initial rip, except I've made an MP3 data CD that I had in my car a couple years ago from that folder, and it works fine. In fact, I "solved" the problem just by grabbing that CD and copying them all back to my NAS box, overwriting the originals.

File corruption is nothing new. That doesn't surprise me. What surprises me is the specificity of the corruption. Random file corruption doesn't target files with metadata marking them as coming from one specific album. ONLY files ripped from one CD were corrupted, but at one point those files worked.

This makes no sense to me. I hate things not making sense to me.

_________________
Well Ali Baba had them forty thieves, Scheherezade had a thousand tales
But master you in luck 'cause up your sleeves you got a brand of magic never fails...
...Mister Aladdin, sir, What will your pleasure be?
Let me take your order, Jot it down -You ain't never had a friend like me

█ ♣ █


Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun Aug 25, 2013 4:53 pm 
Offline
Manchurian Mod
User avatar

Joined: Fri Sep 04, 2009 9:40 am
Posts: 5866
They were all ripped and stored at the same time, it's not out of the question that they'd have ended up in the same sector. When that sector went bad, it took that entire album.

You may have some other files damaged that you just didn't notice because you haven't bothered to look at them.

_________________
Buckle your pants or they might fall down.


Top
 Profile  
Reply with quote  
PostPosted: Sun Aug 25, 2013 5:39 pm 
Offline
Commence Primary Ignition
User avatar

Joined: Thu Sep 03, 2009 9:59 am
Posts: 15740
Location: Combat Information Center
If they're in RAID-1, though, shouldn't the copy on the other disk have been ok?

_________________
"Hysterical children shrieking about right-wing anything need to go sit in the corner and be quiet while the adults are talking."


Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun Aug 25, 2013 6:20 pm 
Offline
Rihannsu Commander

Joined: Thu Sep 03, 2009 9:31 am
Posts: 4709
Location: Cincinnati OH
Something to do with drm or copy protection? Software designed to kill files it thinks are in violation


Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Sun Aug 25, 2013 8:46 pm 
Offline
pbp Hack
User avatar

Joined: Wed Sep 02, 2009 8:45 pm
Posts: 7585
Computers do weird stuff, sometimes with no good explanation. Though "Blame DRM" seems like a good BOFH Excuse of the Day Calendar answer.

_________________
I prefer to think of them as "Fighting evil in another dimension"


Top
 Profile  
Reply with quote  
PostPosted: Sun Aug 25, 2013 10:15 pm 
Offline
User avatar

Joined: Wed Sep 02, 2009 7:59 pm
Posts: 9412
Diamondeye wrote:
If they're in RAID-1, though, shouldn't the copy on the other disk have been ok?

My money is on "the corruption occurred in transmission to copy the data TO the drives." Unless Talya's accessed the files uncorrupted since putting them there, which would blow my theory out of the water.

But that theory would result in the corruption being mirrored.

Alternately, it could be that it's only corrupt on one of the mirrors, and if she does an integrity check, it will discover that the mirrors differ on those files.

_________________
"Aaaah! Emotions are weird!" - Amdee
"... Mirrorshades prevent the forces of normalcy from realizing that one is crazed and possibly dangerous. They are the symbol of the sun-staring visionary, the biker, the rocker, the policeman, and similar outlaws." - Bruce Sterling, preface to Mirrorshades


Top
 Profile  
Reply with quote  
PostPosted: Mon Aug 26, 2013 3:12 pm 
Offline
Commence Primary Ignition
User avatar

Joined: Thu Sep 03, 2009 9:59 am
Posts: 15740
Location: Combat Information Center
I got the impression that she'd ripped the CD from those files, and therefore they were known to be good at one point in the past, but maybe I misunderstood.

Also, if the files get corrupted on one drive in a RAID-1, shouldn't the second drive automatically give you the good files? How does that work?

_________________
"Hysterical children shrieking about right-wing anything need to go sit in the corner and be quiet while the adults are talking."


Top
 Profile  
Reply with quote  
PostPosted: Wed Aug 28, 2013 10:49 am 
Offline
Oberon's Playground
User avatar

Joined: Thu Sep 03, 2009 9:11 am
Posts: 9449
Location: Your Dreams
Diamondeye wrote:
I got the impression that she'd ripped the CD from those files, and therefore they were known to be good at one point in the past, but maybe I misunderstood.

Also, if the files get corrupted on one drive in a RAID-1, shouldn't the second drive automatically give you the good files? How does that work?



One of the issues with RAID-1 mirroring is it doesn't actually protect you from file corruption. It protects you in the event of drive failure, but when data is corrupted for software reasons, there's a good chance it mirrors the corruption to the other drive. RAID-1 and RAID-5 are not backups.

_________________
Well Ali Baba had them forty thieves, Scheherezade had a thousand tales
But master you in luck 'cause up your sleeves you got a brand of magic never fails...
...Mister Aladdin, sir, What will your pleasure be?
Let me take your order, Jot it down -You ain't never had a friend like me

█ ♣ █


Top
 Profile  
Reply with quote  
PostPosted: Wed Aug 28, 2013 12:37 pm 
Offline
User avatar

Joined: Wed Feb 03, 2010 8:20 am
Posts: 1037
Talya wrote:
This is just out of curiosity, I have already fixed the problem, but how it happened is mind boggling to me, and I hate not solving a mystery.

I have a networked hard drive box. Small, cheap, Linux-based EXT formatted DLink box with a lousy 4 TB of drive space on two drives (which I've set up in RAID-1 for redundancy, so 2TB working space) that I store my media on.

In my music folders, I've ripped all my old CDs (and those few I still buy). I have all of Sarah McLachlan's CDs, and the other day, I discovered that all the songs ripped from just one of those CDs (Fumbling Towards Ecstacy) were corrupted, and while still the correct file length, played for all of 2 seconds each, making little electronic noise while they did, but nothing recognizable. All the other songs are fine.

I'd blame the initial rip, except I've made an MP3 data CD that I had in my car a couple years ago from that folder, and it works fine. In fact, I "solved" the problem just by grabbing that CD and copying them all back to my NAS box, overwriting the originals.

File corruption is nothing new. That doesn't surprise me. What surprises me is the specificity of the corruption. Random file corruption doesn't target files with metadata marking them as coming from one specific album. ONLY files ripped from one CD were corrupted, but at one point those files worked.

This makes no sense to me. I hate things not making sense to me.


Take a look at one of the corrupted files in a hex editor, compared to one of the re-ripped versions, or even better download something like BeyondCompare and run a data compare. Do you see any particular patterns? Is the corrupted file a truncated version of the original (with zeros at the end)? Is there some data in it that might resemble another file format? Are the corrupted changes just seemingly random data? The fact that it only plays for a few seconds implies that your MP3 player can recognize one frame but none of the others, and even the data in that segment is wacky (maybe a corrupted bitrate or sampling frequency).

It sounds like everything in just one directory got screwed up (assuming you sort out artists/albums by directory). Even if not, files ripped/copied at the same time are more likely to be in the same physical neighborhood on the HDD. Bad sector that the filesystem didn't correct? Assuming Windows, run a chkdsk /f in case?

EDIT - And if I had read more of the thread, I would have seen Coro say basically the same thing.

_________________
Image Image Image Image Image


Top
 Profile  
Reply with quote  
 Post subject:
PostPosted: Wed Aug 28, 2013 2:59 pm 
Offline
Lean, Mean, Googling Machine
User avatar

Joined: Thu Sep 03, 2009 9:35 am
Posts: 2903
Location: Maze of twisty little passages, all alike
I'm not an ext guru, but...

MP3 files are fairly large relative to your disk sector size, whatever that may be. It would take a fairly large defective region of the disk to corrupt them all. It's possible, but I wouldn't consider it very probable, even provided that the file blocks are all adjacent.

My guess is that you're looking at some kind of inode corruption. That is, the file blocks on disk are not actually corrupted; rather, their inodes are pointing to the wrong blocks. Since all of the files were likely written at about the same time, it's likely that they have adjacent inode structures. Inodes are pretty small structures. One bad write or bad sector could easily fubar a bunch of them at once. This may or may not be something that fsck would detect. Semantical nonsense can nevertheless be syntactically correct.

_________________
Sail forth! steer for the deep waters only!
Reckless, O soul, exploring, I with thee, and thou with me;
For we are bound where mariner has not yet dared to go,
And we will risk the ship, ourselves and all.


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 10 posts ] 

All times are UTC - 6 hours [ DST ]


Who is online

Users browsing this forum: No registered users and 221 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group