View Issue Details
| ID | Project | Category | View Status | Date Submitted | Last Update |
|---|---|---|---|---|---|
| 0000132 | VisualDiffer | Folders differ | public | 2012-10-23 00:49 | 2013-07-09 07:52 |
| Reporter | skh | Assigned To | admin | ||
| Priority | urgent | Severity | major | Reproducibility | always |
| Status | closed | Resolution | unable to reproduce | ||
| Platform | Macbook Pro 6.1 | OS | OS X | OS Version | 10.7.4, 10.7.5 |
| Product Version | 1.4.3 | ||||
| Summary | 0000132: exFAT volume corruption | ||||
| Description | When using Visual Differ with an exFAT external hard drive and copying/deleting files on that volume, depending on time and activity, it becomes first impossible to eject the drive, and later the whole file system may become blocked. In the latter case, it is also impossible to shut down (freezes with a grey screen). After rebooting, this volume is usually marked dirty. Running fsck on that volume brings up different file system errors (e.g. volume bitmap corrupt). Maybe, this behaviour is related to another: when deleting folders, quite often files will be removed from them, but the folders themselves (as well as some of their subfolders) won't be removed. They can be removed later through Finder or any other application except Visual Differ, but maybe this leads to file system corruption. So far I experienced this behaviour 0000019:0000005 times (probably, every time I used Visual Differ on this exFAT volume). I believe that no files were lost, but the file system was damaged four times out of five. I did not test any other exFAT disk for this problem, but prior to using Visual Differ I never had any issues with it. Nor do I now if I manage files through Finder. | ||||
| Steps To Reproduce | 1. Mount an exFAT external volume 2. Run a few folder comparisons, moving and deleting files on this volume 3. Try to eject or do any other maintenance (such as fsck). | ||||
| Additional Information | Sometimes, step 3 is unnecessary because Finder hangs up before that. I do not know how many files should be on the volume or how deep the folder structure. In my case, the total number of files in the beginning was 100–200 thousand and the deepest folder structure had probably 5–6 levels. | ||||
| Tags | No tags attached. | ||||
|
|
I've no external drive so I've formatted a 16Gb USB pendrive to try to reproduce the problem. The copy operations have been very slow due to the slow USB device Test done are shown below - copy the two folders to compare using Finder (operation very slow to the slow USB device) - copy from pendrive to pendrive different folders (folders size about 10Mb with many small files) - stop copy (no UI hangup) - deleted a folder with a deep level set to 20 folders and ~13Mb size - move from mac hard disk to pendrive All tests passed without error and the USB extFAT file system is correct (no corruption) VisualDiffer copies, moves and deletes using standard Apple API so I'm astonished about the **critical** bug you found but I'm unable to reproduce it. Please may you try - to copy/move files greater than 20Mb (file system will be corrupted) - copy only a little set of max 10 files (file system will be corrupted) - simply deleting file corrupt the fs, too? thanks for your feedback PS The bug http://visualdiffer.com/mantis/view.php?id=19#c5 was fixed many time ago indeed now you can stop copy directly from its interface. Maybe the Apple APIs hang internally |
|
|
Hi there, When I received you notes, I had already removed the majority of the folder structure on my exFAT external disk, so the configuration has substantially changed. I cannot do extensive testing because it takes a very long time to fsck a USB drive, but I quickly tried what you suggested. I have transferred to that volume about 80 Gb of data and then used Visual Differ to delete and move files and folders on it. I spent probably one hour doing that and checking the file structure afterwards. There were some files from 10 Mb to about 1 Gb long. Unlike before, I was able to unmount the volume and run fsck on it, and the file systems appeared to be Ok. So, today I was not able to reproduce the issue, it seems. Note, however, that the problem I ran into happened after 2–3 hours of pretty intensive diffing and moving files around or deleting them (at least twice when I was done for the day and wanted to remove the drive). But I did reproduce one glitch mentioned in my original post. When I move or remove folders through Visual Differ, some of them will insist on hanging around (there seems to be no pattern to this behaviour, though). All the files from within these folders (and subfolders) are removed, but if there are subfolders, they are also sometimes left behind. The only way to remove them is to do it from Finder or terminal. When I emptied the trash on this exFAT drive, it took more than an hour to remove about 35,000 items. The file system before and after was reported as healthy, however. I was also very surprised to see any problem apparently connected with my using Visual Differ, because I thought (and you confirmed that) it should use the standard system API. There is probably a chance that this particular exFAT volume is corrupt in a way that fsck is unable to identify. But that still does not explain why Visual Differ cannot remove some folders (and their attributes are identical to those that were deleted normally, by the way). |
|
|
> But that still does not explain why Visual Differ cannot remove some folders (and their attributes are identical to those that were deleted normally, by the way). I don't think VisualDiffer can corrupt a file system considering API calls are legal but I've read something about missing file removal from USB drives (a bug on Apple code) so I'm still investigating this problem but I'm unable to reproduce, I hope to be more lucky |
|
|
Just a quick note, if a folder contains filtered files it will not deleted. The dialog shown when user start deleting/moving/copying alert user to select 'Show filted files' to delete all For example if you are in 'only mismatched' view, only visible files will be deleted Another case is, empty folders are not deleted if 'Show Empty Folders' isn't checked Please verify that **NOT** deleted folders are filtered |
| Date Modified | Username | Field | Change |
|---|---|---|---|
| 2012-10-23 00:49 | skh | New Issue | |
| 2012-10-23 00:49 | skh | Status | new => assigned |
| 2012-10-23 00:49 | skh | Assigned To | => admin |
| 2012-10-23 18:20 | admin | Note Added: 0000174 | |
| 2012-10-23 18:20 | admin | Priority | normal => urgent |
| 2012-10-23 18:20 | admin | Resolution | open => unable to reproduce |
| 2012-10-25 00:49 | skh | Note Added: 0000175 | |
| 2012-10-25 06:44 | admin | Note Added: 0000176 | |
| 2012-10-25 08:56 | admin | Note Added: 0000177 | |
| 2012-10-25 10:52 | admin | Note Edited: 0000177 | |
| 2013-07-09 07:52 | admin | Status | assigned => closed |
