Can't find files because Everything is "Scanning" forever

Found a bug in "Everything"? report it here
Post Reply
cadill
Posts: 7
Joined: Tue Jan 28, 2020 10:05 pm

Can't find files because Everything is "Scanning" forever

Post by cadill »

Every time I start Everything, I'm not able to search because the status at the bottom is stuck on "Scanning..."

Sometimes it's scanning a local NTFS drive, sometimes it's scanning a network folder. I have a few network folders added, but "Monitor Changes" is UNCHECKED for all of them.

I have tried typing "/folder_update_rescan_asap=0" into the search to turn off ASAP scanning. I've also tried the "/monitor_pause" search, just in case, even though I'm not using monitor changes for any folders, only for local NTFS drives.

I've tried rebooting, I've tried reinstalling.

What I want is local drives to be monitored, and for network drives to be indexed just once a day (overnight) and then those indexes to be left alone during the day so I can just use Everything for search with no scanning.

How can I accomplish that goal and get rid of the eternal "Scanning..." ?
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Thanks for the bug report.

The "scanning" status should only occur once.
Folders are updated in the background.

Please make sure Everything is saving your database to disk successfully:
  • In Everything, from the Tools menu, click Options.
  • Click the General tab on the left.
  • Check Store settings and data in %APPDATA%\Everything.
  • Click OK.
Your Everything database should be stored in %LOCALAPPDATA%\Everything

Are you using a custom database location under Tools -> Options -> Indexes -> Database location? -Please try leaving this empty or moving it to a drive other than your C: drive.

If you exit Everything and restart Everything does the scanning always occur? -or does it only occur after restarting your PC?

There could be database corruption forcing Everything to rebuild each time Everything.exe is run.

Could you please try running Everything in debug mode, this will show the rebuild reason:
  • In Everything, type in the following search and press ENTER:
    /debug=1
The next time Everything restarts a debug console will be shown.
Look for the following line:
Rebuild: <rebuild reason here>

What is the rebuild reason? -If unsure, please send your debug output to support@voidtools.com

To disable debug mode:
  • In Everything, type in the following search and press ENTER:
    /debug=0
  • Restart Everything.
cadill
Posts: 7
Joined: Tue Jan 28, 2020 10:05 pm

Re: Can't find files because Everything is "Scanning" forever

Post by cadill »

Thanks for your reply!

After trying your suggestion, I'm still having the issue. Here are details:

Tools > Options > General has a checked "store settings and data in %APPDATA%\Everything". Screenshot: https://www.screencast.com/t/HQPltBijaCD
Tools > Options > Indexes > Database Location is blank. Screenshot: https://www.screencast.com/t/v5T1YI7AoOZ

The directory %appdata%\everything is accessible and has just two files in it:

Everything.ini
Run History.csv

(I looked for hidden and system files but there is nothing else)

The directory %localappdata%\everything is accessible and has one file in it:

Everything.db



The only lines in the debug output that refer to "rebuild" are the 3rd and 4th lines here:

copy config
fire create events
start rebuild thread
rebuild thread started
build fs list
build indexes


The bottom of the Everything window says "Scanning M:\..."
Sometimes it says "Scanning R:\..." or another local drive letter. Screenshot: https://www.screencast.com/t/9dw4AriVei

It stays stuck that way for hours and hours. This occurs every time I start Everything, after "updating database", even after a reboot.

Here are the last few pages of the debug output I grabbed while the Everything window is stuck on "Scanning"
https://www.dropbox.com/s/sdin78z4rfqnw ... l.txt?dl=0

I hope this is helpful.


Thank you for your assistance in diagnosing this issue.
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Thanks for the debug log.

Everything is recreating the entire index.
There's no reason reported.

There two possible cases where no reason is reported:
  • start Everything.exe with the -reindex command line option.
  • The Index structure changed (Index Size/Date Modified/Date Created/Date Accessed/Attributes was toggled from Tools -> Options -> Indexes)
Could you please try letting Everything update, reindex, when indexing is complete immediately exit Everything (right click the Everything system tray icon and click Exit) and restart Everything.

Does the re-indexing ever complete?
Does Everything perform a rescan after the restart?

There's an out of date event for the M: drive. It could be related. Normally, Everything will do a "quick rebuild" and only re-index the M: drive. Unfortunately, that is not happening in this case.

Typically, an out of date event occurs when the USN Journal ID changes or too many changes occurred (missing USN).
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

I've added more debug information to the latest nightly build.

Could you please send the debug output with the latest nightly build?

I've also fixed a rare condition where Everything might get stuck forever reindexing when an out of date event is posted when rebuilding.
cadill
Posts: 7
Joined: Tue Jan 28, 2020 10:05 pm

Re: Can't find files because Everything is "Scanning" forever

Post by cadill »

I'm using version 1.4.1.969 (x64) and the issue of "Scanning" forever is still occurring. Do you have any idea what I can do?
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Could you please send me the debug output with the latest version.
  • In Everything, type in the following search and press ENTER:
    /verbose=1
  • Type in the following search and press ENTER:
    /debug=1
  • Type in the following search and press ENTER:
    /restart
  • What is shown in the debug console when Everything is scanning forever?
tuska
Posts: 1098
Joined: Thu Jul 13, 2017 9:14 am

Re: Can't find files because Everything is "Scanning" forever

Post by tuska »

cadill wrote: Tue May 05, 2020 9:34 pm I'm using version 1.4.1.969 (x64) and the issue of "Scanning" forever is still occurring. Do you have any idea what I can do?
On 5.5.2020 the last version was no longer 1.4.1.969 but 1.4.1.978 (Beta Nightly Builds).
The author has asked you above to use the latest version...
cadill
Posts: 7
Joined: Tue Jan 28, 2020 10:05 pm

Re: Can't find files because Everything is "Scanning" forever

Post by cadill »

I'm using Version 1.4.1.1005 (x64) now, and I still have the same problem. Sometimes the "scanning" stage never ends, even after many days.

It might be helpful to have some meta process watch the scanning process to make sure it's actually finishing in a reasonable time...
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Showing the current folder being scanned would be useful. (it's on my TODO list to add this)

A warning if scanning has taken longer than one day would be useful.
Thanks for the suggestion.


In your case, Everything might be stuck scanning a folder with a circular reparse point target?
Was there any scanning progress shown in the debug console?


Please try disabling folder_update_thread_mode_background:
  • In Everything, type in the following search and press ENTER:
    /folder_update_thread_mode_background=0
  • If successful, you should see folder_update_thread_mode_background=0
    ---If this setting was enabled, Everything may take a very very long time to update remote folders as the rescan will only occur when there is no other disk IO.
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Everything 1.5.0.1270a now shows the current folder being indexed in Tools -> Options -> Folders.

Hover over the "Indexing: folder" text with the mouse cursor to see the full path.
cadill
Posts: 7
Joined: Tue Jan 28, 2020 10:05 pm

Re: Can't find files because Everything is "Scanning" forever

Post by cadill »

Can you believe after all this time I still have this problem?

Often when I open Everything to search, it will just be stuck on scanning one of my drives forever and it will never return any search results.

Version 1.4.1.1020 (x64)

Any progress on fixing this?

Chris
horst.epp
Posts: 1456
Joined: Fri Apr 04, 2014 3:24 pm

Re: Can't find files because Everything is "Scanning" forever

Post by horst.epp »

Why don't you just try the actual Everything 1.5 version ?
______________________________________________________
Windows 11 Home x64 Version 21H2 (OS Build 22000.1042)
Everything 1.5.0.1319a (x64)
void
Developer
Posts: 17149
Joined: Fri Oct 16, 2009 11:31 pm

Re: Can't find files because Everything is "Scanning" forever

Post by void »

Thanks for letting me know the issue still persists cadill,



Please try putting Everything in verbose debug mode:
  • In Everything, type in the following search and press ENTER:
    /debug
  • Type in the following search and press ENTER:
    /verbose
this should show the Everything debug console.
indexing process is shown in Green text.
Is Everything making progress indexing your drives?



Could you please try letting Everything finish scanning.
When scanning completes, immediately exit Everything (right click the Everything system tray icon and click Exit) and restart Everything.

Does Everything perform a rescan after the restart?
-If so, this would indicate an issue with Everything saving your database to disk.
Post Reply