Page 1 of 1

DirSize not reporting a directories size correctly

Posted: Thu Apr 16, 2009 2:17 pm
by cyr0n_k0r
I have a folder on my F: drive. The directory tree looks like this. (only the 1st level is used in this example)
F:\folder1\CrashPlanArchive_m68061442375x002
F:\folder1\test

Here is the command I am using to scan this directory.
dirsize F:\folder1 -1 -nofiles -nostats -nosubs -nowaste >> C:\stats\folder1.txt

Using that command here is the output of folder1.txt
DirSize report, created at 4/12/2009 8:17:42 AM

Total + subs Folder name
-------------- ----------------------------------------
0 bytes F:\folder1 ...
4 KB +--test
-------------- ----------------------------------------
4 KB Cluster size: 4 KB Wastage: 3.9 MB
-------------- ----------------------------------------
As you can see, it looks like DirSize is completely skipping that first folder for some reason. So I tried to alter my command to specifically go into that first folder. Here is the updated command
dirsize F:\folder1\CrashPlanArchive_m68061442375x002 -1 -nofiles -nostats -nosubs -nowaste >> C:\stats\folder1.txt

Here is the updated output with the modified command
DirSize report, created at 4/15/2009 9:15:11 PM

Total + subs Folder name
-------------- ----------------------------------------
1.3 GB F:\folder1\CrashPlanArchive_m68061442375x002 ...
121.6 MB |--356145140919763271 ...
410.9 MB |--356307128558338151 ...
6.6 GB |--357166134952722690 ...
724.7 MB |--357399707359642631 ...
583.2 MB |--358459208039399691 ...
30.3 MB |--359053095531446372 ...
1.8 GB |--362160791226992892 ...
1.2 GB |--362160884593729480 ...
441.9 MB |--362166071555268164 ...
283.1 MB |--362478708046437925 ...
32 KB |--362596874173029950-users-restore_1
70.3 MB |--363215789513252374 ...
205.5 MB |--363216825590226468 ...
103.9 MB |--363217063759584860 ...
798.6 MB |--363334788561509963 ...
1.4 GB |--363470279478877744 ...
894.1 MB |--363492821027528230 ...
1,005.1 MB |--363613628290571809 ...
1.9 GB |--366398015489441892 ...
519.9 MB |--366828293114560534 ...
871.5 MB |--366829076543438894 ...
88.6 MB |--366831919700115823 ...
20 KB |--366846085089460327 ...
710.6 MB |--367241197127233285 ...
111.1 MB |--367372021646491748 ...
4.5 MB +--dbDumps
-------------- ----------------------------------------
1.3 GB Cluster size: 4 KB Wastage: 4.0 MB
-------------- ----------------------------------------
However, this is STILL incorrect.
If I right click on the folder1 folder in windows and click properties it reports over 646GB inside F:\folder1

Any help?

Re: DirSize not reporting a directories size correctly

Posted: Sat Apr 18, 2009 8:06 pm
by DataMystic Support
Which version of DirSize is this?

Right-clicking a folder in Windows gives you the size of the folder+subfolders, whereas the dirsize report you are requesting is not displaying this info.

It looks like F:\folder1\CrashPlanArchive_m68061442375x002 takes 1.3GB on its own without subfolders.

It seems you have manually edited the results- with -nosubs the header should say
.... Folder name [Without subfolders]
and it also shows the version number.

Can you please provide more info?

Re: DirSize not reporting a directories size correctly

Posted: Sun Apr 19, 2009 10:38 am
by cyr0n_k0r
I have not edited the output.
This is Dirsize 4.8

The Crashplan directory does not have 1.3GB.. it has over 646GB inside of it.
That is the problem, DirSize is not scanning the folder correctly. It is not reporting the correct amount.

To prove this here is a scan of the folder using the most basic scan options.

dirsize F:\folder1 >> C:\stats\folder1.txt
DirSize report, created at 4/18/2009 5:35:47 PM

Total + subs Wstd Files Folder name [Without subfolders]
-------------- ---- ------ ----------------------------------------
21.9 GB 97% 0 F:\folder1 [4 KB]
21.9 GB 100% 184 |--CrashPlanArchive_m68061442375x002 ... [4 KB]
121.6 MB 60% 10 | |--356145140919763271 [60 KB]
121.5 MB 0% 2 | | +--cpbf0000000000000000000
413.6 MB 58% 10 | |--356307128558338151 [60 KB]
413.5 MB 0% 2 | | +--cpbf0000000000000000000
157.1 MB 1% 22 | |--357129651571130728 ... [8.9 MB]
1.2 GB 0% 2 | | +--cpbf0000000000000265995
7.9 GB 1% 16 | |--357166134952722690 ... [12.3 MB]
779.3 MB 0% 2 | | |--cpbf0000000000000048104
2.0 GB 0% 2 | | |--cpbf0000000000000104082
2.0 GB 0% 2 | | |--cpbf0000000000000165359
965.7 MB 0% 2 | | |--cpbf0000000000000197713
588.3 MB 0% 2 | | |--cpbf0000000000000230077
993.8 MB 0% 2 | | |--cpbf0000000000000262445
1.9 GB 0% 2 | | +--cpbf0000000000000382123
914.2 MB 1% 28 | |--357399707359642631 ... [27.8 MB]
452 KB 3% 2 | | |--cpbf0000000000000000000
16.9 MB 0% 2 | | |--cpbf0000000000000044203
89.5 MB 0% 2 | | |--cpbf0000000000000087122
1.6 MB 1% 2 | | |--cpbf0000000000000135890
2.6 MB 1% 2 | | |--cpbf0000000000000188670
2.6 MB 0% 2 | | |--cpbf0000000000000240952
540 KB 2% 2 | | |--cpbf0000000000000293185
540 KB 2% 2 | | |--cpbf0000000000000347057
540 KB 2% 2 | | |--cpbf0000000000000397625
540 KB 2% 2 | | |--cpbf0000000000000451314
1.2 GB 0% 2 | | +--cpbf0000000000000923888
1.0 GB 2% 18 | |--358459208039399691 ... [4.1 MB]
1.2 GB 0% 2 | | +--cpbf0000000000000207077
30.3 MB 47% 10 | |--359053095531446372 [88 KB]
30.2 MB 0% 2 | | +--cpbf0000000000000000000
3.3 GB 4% 100 | |--361628197097316296 ... [13.5 MB]
2.0 GB 0% 2 | | |--cpbf0000000000000000000
554.4 MB 0% 2 | | |--cpbf0000000000001401765
540 KB 2% 2 | | |--cpbf0000000000001453272
540 KB 2% 2 | | |--cpbf0000000000001506423
452 KB 3% 2 | | |--cpbf0000000000001557671
452 KB 3% 2 | | |--cpbf0000000000001607010
452 KB 3% 2 | | |--cpbf0000000000001654782
1.1 MB 1% 2 | | |--cpbf0000000000001703020
2.6 MB 0% 2 | | |--cpbf0000000000001750958
1.9 GB 0% 2 | | |--cpbf0000000000001804429
2.0 GB 0% 2 | | +--cpbf0000000000002183121
1.8 GB 1% 10 | |--362160791226992892 [4.7 MB]
1.6 GB 0% 2 | | |--cpbf0000000000000000000
11.8 MB 0% 2 | | |--cpbf0000000000000045519
16.4 MB 0% 2 | | |--cpbf0000000000000058842
188.3 MB 0% 2 | | +--cpbf0000000000000073479
1.3 GB 0% 12 | |--362160884593729480 ... [50.6 MB]
1.3 GB 0% 2 | | +--cpbf0000000000000095070
139.5 MB 0% 18 | |--362164112060325443 ... [236.4 MB]
99.0 MB 0% 2 | | +--cpbf0000000000000475590
442.0 MB 1% 10 | |--362166071555268164 [3.1 MB]
438.9 MB 0% 2 | | +--cpbf0000000000000000000
428.3 MB 0% 12 | |--362478708046437925 ... [44.0 MB]
433.6 MB 0% 2 | | +--cpbf0000000000000085715
32 KB 25% 1 | |--362596874173029950-users-restore_1
347.8 MB 9% 10 | |--363215789513252374 [384 KB]
347.5 MB 0% 2 | | +--cpbf0000000000000000000
224.1 MB 0% 36 | |--363216394533215774 ... [51.5 MB]
818.7 MB 0% 2 | | +--cpbf0000000000000511149
226.9 MB 0% 16 | |--363216825590226468 ... [23.9 MB]
351.0 MB 0% 2 | | +--cpbf0000000000000238045
103.9 MB 54% 10 | |--363217063759584860 [72 KB]
103.9 MB 0% 2 | | +--cpbf0000000000000000000
773.2 MB 0% 10 | |--363334788561509963 [43.2 MB]
730.0 MB 0% 2 | | +--cpbf0000000000000000000
1.5 GB 1% 10 | |--363470279478877744 [5.7 MB]
1.5 GB 0% 2 | | +--cpbf0000000000000000000
859.9 MB 0% 24 | |--363492821027528230 ... [77.0 MB]
1.1 GB 0% 2 | | +--cpbf0000000000000137832
1,005.2 MB 4% 10 | |--363613628290571809 [868 KB]
1,004.3 MB 0% 2 | | +--cpbf0000000000000000000
356.8 MB 2% 12 | |--366255566792163716 ... [2.9 MB]
402.6 MB 0% 2 | | +--cpbf0000000000000143283
1.9 GB 1% 10 | |--366398015489441892 [5.7 MB]
1.9 GB 0% 2 | | +--cpbf0000000000000000000
532.4 MB 2% 10 | |--366828293114560534 [2.3 MB]
530.0 MB 0% 2 | | +--cpbf0000000000000000000
896.0 MB 2% 10 | |--366829076543438894 [1.9 MB]
894.1 MB 0% 2 | | +--cpbf0000000000000000000
97.0 MB 23% 10 | |--366831919700115823 [160 KB]
96.9 MB 0% 2 | | +--cpbf0000000000000000000
20 KB 95% 8 | |--366846085089460327 [16 KB]
4 KB 98% 0 | | +--cpbf0000000000000000000
1.1 GB 3% 12 | |--367241197127233285 ... [2.0 MB]
1.1 GB 0% 2 | | +--cpbf0000000000000193696
111.1 MB 2% 10 | |--367372021646491748 [2.6 MB]
108.5 MB 0% 2 | | +--cpbf0000000000000000000
832.9 MB 0% 12 | |--367609337100632321 ... [75.1 MB]
806.9 MB 0% 2 | | +--cpbf0000000000000105956
5.0 MB 2% 30 | +--dbDumps
4 KB 98% 0 +--test
-------------- ---- ------ ----------------------------------------
21.9 GB 0% 827 Cluster size: 4 KB Wastage: 4.0 MB
-------------- ---- ------ ----------------------------------------

Statistics for Drive F:storage2 (NTFS)
Cluster size: 4 KB
Free space: 1,982.9 GB ( 35% of capacity is free)
Used space: 3,603.0 GB
Capacity: 5,585.9 GB
As you can see, now it lists the folder as being 21.9GB in size. But that is incorrect too.

Re: DirSize not reporting a directories size correctly

Posted: Sun Apr 19, 2009 9:21 pm
by DataMystic Support
Hi Hazen,

(You're right about the version in the header - we just added that).

The current version is 4.9.1 - can you please try it out from
http://www.datamystic.com/dirsize2.exe

or login to download the full version from the secure area?

Re: DirSize not reporting a directories size correctly

Posted: Mon Apr 20, 2009 9:49 am
by cyr0n_k0r
That was the problem. I upgrade to the new version and now DirSize reports the correct size.
In the version info it says this new version supports file sizes larger than 4GB. Is there a limit to the file size?
I routinely have files stored that can be anywhere from 10-30GB in size. Sometimes a single file can even be in the hundreds of GB.

Re: DirSize not reporting a directories size correctly

Posted: Tue Apr 21, 2009 10:36 am
by DataMystic Support
Offhand the new limit would be approx 18446744065119617025 ie 2^64-1.