Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

General discussion related to "Everything".
Post Reply
meteorquake
Posts: 523
Joined: Thu Dec 15, 2016 9:44 pm

Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

Post by meteorquake »

Network folder scanning is a little temporamental (it is on 'monitor changes').
Often you do something and Everything instantly reflects it. But sometimes it appears to be very slack in doing so.
I mentioned once before the idea of Everything noting your file action performed in everything to do a definite immediate update, anyone doing file operations mostly or entirely in Everything will find that useful - I imagine that's under consideration if it's viable (perhaps it already is but needs improving?)
So my question is, is there a way to force a rescan of a selected branch within a network folder that's indexed, as usually one is working on a particular area, and rescanning the entire folder is overkill, especially where large, when just a small portion needs more regular update.
Perhaps subportions can be designated with a different update rate under the Folders tab? you could add the folder with a different rescan setting, and Everything could recognise it is a subfolder of one of the other Folders entered and so not duplicate the indexing, but adopt different scanning timings for the designated branches.
Or - and perhaps this is the best course - Everything could note the folders getting changed (either by actions noted within Everything or external updates spotted during a scan) and intelligently rescan at a faster rate those branches, which is a variant on the tracking the file actions you do, which would cover the possibility of some actions being performed outside of Everything.
David
void
Developer
Posts: 17152
Joined: Fri Oct 16, 2009 11:31 pm

Re: Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

Post by void »

So my question is, is there a way to force a rescan of a selected branch within a network folder that's indexed
Type in the following search and press ENTER:

/rescan \\server\share\folder\subfolder

(where \\server\share\folder\subfolder is your desired folder to rescan)
Subfolders are also rescanned.



Moving a folder to another location and then back again will cause Everything to rescan the moved folder.



Consider running the Everything Server on a dedicated PC to keep your network folders up to date.
You can add nested folders with different scheduled rescan times, duplicated results are removed by the Everything server.



Everything shouldn't be missing any folders changes.
What type of hardware/OS are you using on your NAS?
meteorquake
Posts: 523
Joined: Thu Dec 15, 2016 9:44 pm

Re: Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

Post by meteorquake »

Thanks! I'll bookmark that snippet, and I see the multiple schedule idea is already there.

* Can I suggest under that folders tab it could say something like " (subfolders of existing scans with different schedules can be added)"

This particular one arose with NTFS-NTFS over USB2-ethernet to gigabit port direct link (not via a router); I should probably add a server instance on the target, it was probably laziness, and maybe an old memory of remapping not happening properly although I bet that's sorted now. Also some work ones to a Linux server (SMB1 unless it's been changed up to SMB2).
(In case anyone wonders about the logic there, I use this laptop as a light portable remote screen as it's slow and only has 4 Gb hardly enough to open a browser tab these days; the old target desktop is fast and with 8 Gb but its monitor doesn't work now and anyway is not portable as I work in a reclined position; the drives are on the viewing laptop not the desktop because there are frequent powercuts here! So I'm remote viewing a desktop using the drives of the originating remote viewer all over a direct cable link, which is much faster and more stable than the laptop's wifi link...)

I'll try to keep an eye out for it happening and add any further details...

D
meteorquake
Posts: 523
Joined: Thu Dec 15, 2016 9:44 pm

Re: Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

Post by meteorquake »

Actually I think this would be a good example of where a variable for the currently-selected sidebar directory would be useful on the lines of
/rescan $directory
so you would then make a bookmark and tie a keyboard shortcut to rescan based on the folderbar folder chosen (or path commonality if multiple folders).
I'm not sure if it became implemented, there was an old discussion about the usefulness of using it to create a column for the path column showing a string relative to the folderbar (at viewtopic.php?p=68913&hilit=folderbar#p68913 )
d
void
Developer
Posts: 17152
Joined: Fri Oct 16, 2009 11:31 pm

Re: Network Folder Scanning : Manual scan of subbranch, or different update rates for subfolders

Post by void »

* Can I suggest under that folders tab it could say something like " (subfolders of existing scans with different schedules can be added)"
You will still end up duplicates on the server side.
It's the server -> client transfer that removes duplicates.


I'll try to keep an eye out for it happening and add any further details...
See if a folder move triggers the issue.
Does Everything completely stop monitoring? or are only some changes missed?
-Are you making thousands of changes a second? -Please consider enabling Tools -> Options -> Folders -> <your NAS share> -> Rescan on full buffer.
-Rescan on full buffer will perform a full rescan if too many changes occurred in a short time.

Another option is to disable ReadDirectoryChanges and use SHChangeNotify instead:
  • In Everything 1.5, from the Tools menu, click Options.
  • Click the Advanced tab on the left.
  • To the right of Show settings containing, search for:
    read dir
  • Select: read_directory_changes
  • Set the value to: false
  • Click OK.
  • Restart Everything (File -> Exit)
Everything uses ReadDirectoryChanges by default.
If disabled, Everything falls back to SHChangeNotify.
SHChangeNotify will not pickup all remote changes, but should pickup all local changes.


/rescan $directory
so you would then make a bookmark and tie a keyboard shortcut to rescan based on the folderbar folder chosen (or path commonality if multiple folders).
This should work already:

/rescan $directory:


I will consider support for multiple folders.
Thank you for the suggestions.
Post Reply