425 Commits

Author SHA1 Message Date
Jean-Francois Dockes
02c9a6f3f7 Slightly experimental change to speed up indexer exit after interrupt by closing up all queues. 2021-11-24 19:46:56 +01:00
Jean-Francois Dockes
5f2716e628 Index: the fs indexer would return early on interrupt, without flushing the queues, causing the Xapian db close to be possibly called with the db update thread still active 2021-11-24 19:04:28 +01:00
Jean-Francois Dockes
756a944ef3 Probably null change: make sure that all classes with destructors also have copy constructors and assignment operators 2021-11-23 16:38:11 +01:00
Jean-Francois Dockes
31348b5470 Allow recollindex to adjust its oom killer "badness" on startup 2021-09-15 20:12:20 +02:00
FeRD (Frank Dana)
a1f78ba57c Make systemd units installable 2021-07-01 21:18:48 -04:00
Jean-Francois Dockes
2a92200012 Added 2 example files and documentation for starting recollindex with systemd 2021-07-01 10:15:20 +02:00
Jean-Francois Dockes
900f718074 fix small clang warnings 2021-04-21 03:51:46 -07:00
Jean-Francois Dockes
513e2e6958 last minute oops in previous 2021-04-16 13:30:02 +02:00
Jean-Francois Dockes
f1b2d3004a Simplified the indexing status update code by treating the updater as a singleton
Add a 'flushing' state for when we commit the Xapian index.
2021-04-16 13:27:53 +02:00
Jean-Francois Dockes
7ca99612f7 bump version + comments + touchups 2021-04-01 15:59:15 +02:00
Jean-Francois Dockes
4756b1252b Add recollindex option to write file not indexed reasons to diagnostics file 2021-04-01 10:32:04 +02:00
Jean-Francois Dockes
485a0fc650 add recollindex option to take a list of files and indicate which are indexed or not 2021-03-31 16:18:11 +02:00
Jean-Francois Dockes
8da0bf28cc GUI: add popup menu option to copy simple file name. fix typo keytcfn->keyctfn. Change utf8check() parms for easier usage 2021-03-27 09:00:28 +01:00
Jean-Francois Dockes
485a077737 Convert recollindex to using getopt_long and add options to compact and burst the webcache 2021-03-25 14:11:53 +01:00
Jean-Francois Dockes
8fde38975a Web indexing: add a parameter to specify at what frequency a page should be stored again: none/day/week/month/year. Previously, only one instance could be kept, which is still the default 2021-03-24 10:58:41 +01:00
Jean-Francois Dockes
f614b28687 Web indexer: actually store the doc size. Display date and size in cache editor 2021-03-22 16:08:08 +01:00
Jean-Francois Dockes
f2407c3394 Enable recollindex command line option to use posix_fadvise() to spare the page cache 2021-02-25 19:08:43 +01:00
Jean-Francois Dockes
818b79b135 Windows: simplified recollindex argument passing.
Because of the use of wmain(), we don't need the imperfect method of using
a temporary file. This should have been simplified when switching to wmain
but was not for lack of time.
2021-02-25 15:30:17 +00:00
Jean-Francois Dockes
905f94b961 Experimental: configure option to call posix_fadvise(POSIX_FADV_DONTNEED) on each indexed file. If enabled, can be disabled at run time by setting NO_NOCACHE_INDEXED in the environment. 2021-02-24 16:00:40 +01:00
freddii
89c7efe682 fixed typos 2021-02-04 17:12:22 +01:00
Jean-Francois Dockes
2d90b80bb5 1st steps for a mac build using qtcreator and based on the .pro files used on Windows 2021-02-02 17:44:23 +01:00
Jean-Francois Dockes
8111320a22 Indicate log location in some indexer error messages which will be displayed in the GUI 2020-11-19 11:16:51 +01:00
Jean-Francois Dockes
022121931a Fix real-time indexer indexing nothing in rare case where topdirs was /, because of incorrect path/skippedPaths test 2020-11-04 14:35:45 +01:00
Jean-Francois Dockes
3716ea3dac unify processing for executing a python script 2020-09-28 14:04:09 +02:00
Jean-Francois Dockes
c1ef2187d3 Fixed LOG calls obsolescence issues preventing build with staticverbosity 7 2020-09-06 14:59:00 +01:00
Jean-Francois Dockes
5ea2f7cc64 recollindex: make sure that the computed lock file path is the same in all cases. Take the lock in a number of forgotten cases 2020-08-31 11:28:44 +02:00
Jean-Francois Dockes
96ba5acd32 indents 2020-07-15 10:47:18 +02:00
Jean-Francois Dockes
5915dd6cea recollindex -r: make path args absolute using the original working directory, not the rundir (tmp) 2020-07-13 10:47:32 +02:00
Jean-Francois Dockes
cd29fd581d Windows7: the flags passed to widetomultichar was not correct.
Also no wmain with our mingw version.
2020-06-11 14:49:44 +02:00
Jean-Francois Dockes
f15e3f21fa Windows: replace unlink() with unicode-capable path_unlink() 2020-06-02 10:56:55 +01:00
Jean-Francois Dockes
cb3a59f88f Windows recollindex: use wmain to accept unicode command line args. 2020-06-02 09:13:31 +01:00
Jean-Francois Dockes
560041cab9 cleared out errant tabs 2020-05-30 15:54:49 +02:00
Jean-Francois Dockes
2f794be314 Fix Windows gcc build. Needs some def to get w7+ windows api 2020-04-25 11:41:37 +02:00
Jean-Francois Dockes
71b03da3ea fix warning fix 2020-04-17 15:29:38 +02:00
Jean-Francois Dockes
39c152bada Fixed MSVC warnings, all inocuous 2020-04-17 14:26:40 +01:00
Jean-Francois Dockes
d67fe267d8 Fix modification of recollindex args processing which was broken 2020-04-16 18:01:34 +02:00
Jean-Francois Dockes
d28cb0230d recollindex: allow reading args from file arg to ease passing args on windows 2020-04-14 16:19:04 +02:00
Jean-Francois Dockes
a468406e17 windows/qtcreator msvc adjustements 2020-04-04 14:00:39 +01:00
Jean-Francois Dockes
34d23589a2 remove struct stat from interfaces 2020-03-31 11:17:07 +02:00
Jean-Francois Dockes
aa40531bbe add idxniceprio parameter to choose indexing process priority 2020-01-31 09:29:02 +01:00
Jean-Francois Dockes
414222c003 use conftree conversions 2019-12-02 09:37:34 +01:00
Jean-Francois Dockes
a1138dd9e5 Windows, firefox plugin:make sure the temp files are closed before remove 2019-11-25 13:30:05 +01:00
Jean-Francois Dockes
0489df84e2 Forgot a part of the change for web queue dotfiles prefix change 2019-11-25 12:12:13 +01:00
Jean-Francois Dockes
a1122c4e8a Fix format string used to generate/scan circache headers.
Use _ not . as prefix for webqueue metadata files
Fix log messages and indent
2019-11-24 15:02:30 +01:00
Jean-Francois Dockes
726781434e typos in windows changes to enable web indexer 2019-11-24 11:01:32 +01:00
Jean-Francois Dockes
83e29a9b01 Windows: enable the firefox recent history indexer. 2019-11-24 10:46:23 +01:00
Jean-Francois Dockes
c11cac2868 orthograph, mostly in comments, also man pages 2019-10-18 09:13:10 +02:00
Jean-Francois Dockes
ee8c5410bd Avoid purging existing subdocuments on file indexing error (e.g.: maybe a file lock issue that will go away) 2019-06-21 17:18:15 +02:00
Jean-Francois Dockes
45043b816f add onlyNames config variable for filtering file names 2019-06-17 08:28:14 +02:00
Jean-Francois Dockes
e38e58c37a In case the self-doc was not sent first by the handler, its udi was not recalculated, and it clobbered the last subdoc 2019-06-16 13:46:00 +02:00