hello,
I have more than 100 million files in everything server, actually they are logs from manufacturing test data, every file name contains serial number of products tested. if I am going to search some serial numbers' test data, let's say 10 thousand. normally I use below keywords: SN1|SN2|SN3...... It takes quite some time if serial numbers more than 300 (1-2minutes for 300 keywords). If keywords are more than 500, everything will stuck there for long time, it is quite painful if I need to search 10 thousand, need to code to spit input serial numbers to batch and search them one batch by one batch and finally combine them together.
Is there a way better than concate these keywords with | only?
thanks!
is there a way to expedite a search with many input keywords with |
Re: is there a way to expedite a search with many input keywords with |
regex: may offer better performance here.
Please try:
regex:"SN1|SN2|SN3|..."
You'll still need to use | to separate names.
Can you tell us a little more about the filename format, do the filenames start with the serial number? end with the serial number? have some specific prefix?
For example:
startwith:<SN1|SN2|SN3|...>
Please make sure match path is unchecked under the Search menu.
Searching the full path for 100 million+ files with a large | list will hurt performance.
Please try using match case and match diacritics for improved performance:
case:diacritics:<SN1|SN2|SN3|...>
You can paste multi-line text into the Everything search box.
Each line is separated with: |
This might help with entering your search.
(requires Everything 1.5)
There's also file list slots, but these will not help performance unless you are matching the full filename.
Please try:
regex:"SN1|SN2|SN3|..."
You'll still need to use | to separate names.
Can you tell us a little more about the filename format, do the filenames start with the serial number? end with the serial number? have some specific prefix?
For example:
startwith:<SN1|SN2|SN3|...>
Please make sure match path is unchecked under the Search menu.
Searching the full path for 100 million+ files with a large | list will hurt performance.
Please try using match case and match diacritics for improved performance:
case:diacritics:<SN1|SN2|SN3|...>
You can paste multi-line text into the Everything search box.
Each line is separated with: |
This might help with entering your search.
(requires Everything 1.5)
There's also file list slots, but these will not help performance unless you are matching the full filename.
Re: is there a way to expedite a search with many input keywords with |
Thanks.
These files' names start with SN. for example:
W0PAL27_Final2_TraceView_20210310_172757_DUTORDERED_CHAN0.txt
this is a real file name.
W0PAL27 is the SN.
Final2 is my test station, it is known and fixed for my search.
TraceView is the fixed string.
the rest are test time stamp and other info.
seems i can use startwith?
These files' names start with SN. for example:
W0PAL27_Final2_TraceView_20210310_172757_DUTORDERED_CHAN0.txt
this is a real file name.
W0PAL27 is the SN.
Final2 is my test station, it is known and fixed for my search.
TraceView is the fixed string.
the rest are test time stamp and other info.
seems i can use startwith?
Re: is there a way to expedite a search with many input keywords with |
For Everything 1.4, please try:
case:diacritics:startwith:SN1|case:diacritics:startwith:SN2|case:diacritics:startwith:SN3|...
-or-
case:regex:"^(SN1|SN2|SN3|...)"
With Everything 1.5, please try:
case:diacritics:startwith:<SN1|SN2|SN3|...>
case:diacritics:startwith:SN1|case:diacritics:startwith:SN2|case:diacritics:startwith:SN3|...
-or-
case:regex:"^(SN1|SN2|SN3|...)"
With Everything 1.5, please try:
case:diacritics:startwith:<SN1|SN2|SN3|...>
Re: is there a way to expedite a search with many input keywords with |
Thanks!
now I can get 1000 SNs in 30s (10k files, full path and recent modified date time) and 16k SNs (160k files) in 6.5 minutes.
It is huge improvement than before!
now I can get 1000 SNs in 30s (10k files, full path and recent modified date time) and 16k SNs (160k files) in 6.5 minutes.
It is huge improvement than before!
Re: is there a way to expedite a search with many input keywords with |
And what, "case:diacritics:startwith:", while not needed, per se, are filters, so end up lessening what needs to be done, & with such a huge number of files, it makes a difference?