I have made it a habit of downloading my network occasionally, perhaps once a week, though I don't know usually do it that often.
Tonight, I was checking the size of the entire archive and found it was 13.3 G bytes which surprised me. So, I decided to take a closer look. I found most of the space was taken up by photos (9G). I looked at those, sorting them by size. The largest ones were 9.2M and to my surprise, it was the same photo there 7 times. The next was 7.4M and it was duplicated 7 times, and was of the same girl in the first picture. At first, I thought I had a user who had uploaded the same photo repeatedly, but I looked at the file, ning-videos-local.json, and there was only one reference to it.
So, I think that each time I archived the site, I downloaded another copy of each photo. I had assumed that only new content would be downloaded each time I archived the site, but I guess that's not the case.
Can you change it so we don't wind up with duplicates? And preferably, only download new content. Old content no longer on the site could be moved to another folder.