We have an odd issue which has recently started. We have 4 offices connected using DFSR replicating 1,300,000 files. We recently replaced 2 older servers with 2012 standard boxes with two other 2003r2 servers still in place. Everything has worked for 1-2 months however in the last week every night the DFS decides to run some kind of consistency check and I will see a backlog of 1,300,000 files waiting to go from one server to all of the others. The backlog appears every night at 1AM.
So far I have:
Disabled Sophos on the member that generates the backlog
Backup finishes by 21.30
Nothing in the event viewer around this time
No server reboots or updates during this time.
Checking the debug logs, at midnight we start to generate approx 26 debug logs per minute (so I am assuming this is when it starts)
Below is the last log entry before it starts flooding the log with the RefreshRecord entries:
20130723 00:00:00.600 8472 DBGC 531 GcTask::Step Start garbage collection. volId:{FBD8829C-9AB9-44FF-A54C-2886A885146E} volPath:\\.\D:
20130723 00:00:00.851 8472 DBGC 1311 GcTask::RefreshRecord LDB Updating ID Record:
+ fid 0x0
+ usn 0x0
+ uidVisible 1
+ filtered 0
+ journalWrapped 0
+ slowRecoverCheck 0
+ pendingTombstone 0
+ internalUpdate 0
+ dirtyShutdownMismatch 0
+ meetInstallUpdate 0
+ meetReanimated 0
+ recUpdateTime 20130718 23:00:01.292 GMT
+ present 0
+ nameConflict 0
+ attributes 0x0
+ ghostedHeader 0
+ data 0
+ gvsn {E20CD499-2367-4059-9E7C-99EFAC6B455D}-v10740592
+ uid {3968F665-6CDD-07AC-1146-42F1ED29E6D6}-v2
+ parent {00000000-0000-0000-0000-000000000000}-v0
+ fence Default (3)
+ clockDecrementedInDirtyShutdown 0
+ clock 16010101 00:00:00.000 GMT (0xe0)
+ createTime 16010101 00:00:00.000 GMT
+ csId {03516585-72EA-4F9A-8D1A-AD5C5CE68373}
+ hash 00000000-00000000-00000000-00000000
+ similarity 00000000-00000000-00000000-00000000
+ name VersionVectorTombstone
+
20130723 00:00:00.851 8472 DBGC 1311 GcTask::RefreshRecord LDB Updating ID Record:
+ fid 0xCF48282400000000
+ usn 0x0
+ uidVisible 1
+ filtered 0
+ journalWrapped 0
+ slowRecoverCheck 0
+ pendingTombstone 0
+ internalUpdate 0
+ dirtyShutdownMismatch 0
+ meetInstallUpdate 0
+ meetReanimated 0
+ recUpdateTime 20130718 23:00:01.308 GMT
+ present 0
+ nameConflict 0
+ attributes 0x20
+ ghostedHeader 0
+ data 0
+ gvsn {E20CD499-2367-4059-9E7C-99EFAC6B455D}-v10740593
+ uid {CF73BFD7-0139-4A64-8AF3-7DB0F7914FC7}-v3905523
+ parent {CF73BFD7-0139-4A64-8AF3-7DB0F7914FC7}-v3905391
+ fence Default (3)
+ clockDecrementedInDirtyShutdown 0
+ clock 20130411 16:34:10.925 GMT (0x1ce36d26533d68e)
+ createTime 20110317 16:46:51.419 GMT
+ csId {03516585-72EA-4F9A-8D1A-AD5C5CE68373}
+ hash 4EA6DF0D-32DD9B4C-6D575BB6-EB071E07
+ similarity 1C0C3C35-15001A22-1E020011-3F2B0333
+ name <FILENAME REMOVED>.pdf
+
Anyone have any thoughts as I am lost on this one on where to even look!
Thanks
Dominic