tris/recoll
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
5,603 Commits 4 Branches 0 Tags
Commit Graph

93 Commits

Author SHA1 Message Date
Jean-Francois Dockes
f1b2d3004a Simplified the indexing status update code by treating the updater as a singleton 
Add a 'flushing' state for when we commit the Xapian index.
 2021-04-16 13:27:53 +02:00
Jean-Francois Dockes
4756b1252b Add recollindex option to write file not indexed reasons to diagnostics file 2021-04-01 10:32:04 +02:00
Jean-Francois Dockes
8da0bf28cc GUI: add popup menu option to copy simple file name. fix typo keytcfn->keyctfn. Change utf8check() parms for easier usage 2021-03-27 09:00:28 +01:00
Jean-Francois Dockes
f2407c3394 Enable recollindex command line option to use posix_fadvise() to spare the page cache 2021-02-25 19:08:43 +01:00
Jean-Francois Dockes
905f94b961 Experimental: configure option to call posix_fadvise(POSIX_FADV_DONTNEED) on each indexed file. If enabled, can be disabled at run time by setting NO_NOCACHE_INDEXED in the environment. 2021-02-24 16:00:40 +01:00
Jean-Francois Dockes
022121931a Fix real-time indexer indexing nothing in rare case where topdirs was /, because of incorrect path/skippedPaths test 2020-11-04 14:35:45 +01:00
Jean-Francois Dockes
c1ef2187d3 Fixed LOG calls obsolescence issues preventing build with staticverbosity 7 2020-09-06 14:59:00 +01:00
Jean-Francois Dockes
34d23589a2 remove struct stat from interfaces 2020-03-31 11:17:07 +02:00
Jean-Francois Dockes
ee8c5410bd Avoid purging existing subdocuments on file indexing error (e.g.: maybe a file lock issue that will go away) 2019-06-21 17:18:15 +02:00
Jean-Francois Dockes
45043b816f add onlyNames config variable for filtering file names 2019-06-17 08:28:14 +02:00
Jean-Francois Dockes
e38e58c37a In case the self-doc was not sent first by the handler, its udi was not recalculated, and it clobbered the last subdoc 2019-06-16 13:46:00 +02:00
Jean-Francois Dockes
4d7d1a7965 windows powerfail signal: stop indexing only on resume and topdirs change 2019-03-19 14:38:57 +01:00
Jean-Francois Dockes
0cbc46732f Fixed the FSF address 2019-03-04 11:19:14 +01:00
Jean-Francois Dockes
399c633efd Avoid purging documents from absent mountable volumes 2019-02-03 18:51:52 +01:00
Jean-Francois Dockes
bde991c08a got rid of off_t 2017-02-28 20:36:01 +01:00
Jean-Francois Dockes
fff59f7814 missing cnf->setKeyDir() in processonefile could result in wrong local params being used (e.g. excludedmimetypes) 2017-02-22 16:10:32 +01:00
Jean-Francois Dockes
e0a79455ae Make path searches case-insensitive on windows. 2016-08-06 12:20:45 +02:00
Jean-Francois Dockes
c1fad4afc7 Replaced pthread with std:: thread and mutex 2016-07-12 18:08:21 +02:00
Jean-Francois Dockes
f6a999de84 logging now uses c++ streams 2016-07-12 09:41:04 +02:00
Jean-Francois Dockes
d0400bdce7 slightly improve indexing stats by keep a count of file errors and remembering the total files 2016-04-11 17:23:02 +02:00
Jean-Francois Dockes
a4fd4ee5be moved code around to make smallut and pathut less recoll-specific and reusable. No actual changes 2016-03-21 12:55:31 +01:00
Jean-Francois Dockes
ff15f8fb1c Centralize stat calls to ensure consistency of time fields on windows 2016-01-08 11:23:10 +01:00
Jean-Francois Dockes
63802a4005 housekeeping: separated out the chrono utility 2015-10-14 09:18:26 +02:00
Jean-Francois Dockes
d942242047 replace all %lld instances 2015-10-03 17:25:17 +02:00
Jean-Francois Dockes
8022515a00 Fix computation of file:// urls from paths 
--HG--
branch : WINDOWSPORT
 2015-09-02 09:11:25 +02:00
Jean-Francois Dockes
1cbf02f713 Suppressed many integer size warnings by a mix of type adjustments and casts, 
none of which should have a real effect.

--HG--
branch : WINDOWSPORT
 2015-09-01 19:39:20 +02:00
Jean-Francois Dockes
94da56aadc Handle windows paths: mostly change tests for relative, and some other tweaks. 
--HG--
branch : WINDOWSPORT
 2015-08-31 17:20:04 +02:00
Jean-Francois Dockes
14c8e740d6 Windows: fixed a number of int size warnings mostly by casting them away 
--HG--
branch : WINDOWSPORT
 2015-08-30 17:30:31 +02:00
Jean-Francois Dockes
d4cd1dd91c 1st mods to get a build under windows. Does not build yet, far from it 
--HG--
branch : WINDOWSPORT
 2015-08-30 11:19:18 +02:00
Jean-Francois Dockes
c6e228b7c6 Prepared windows port by removing a number of spurious reference to unix-specific interfaces, and using some xapian posix adaptor includes 2015-08-19 14:41:10 +02:00
Jean-Francois Dockes
e6c0ca403d recollindex: do not retry files which previously failed to be indexed, except if they were changed since, or option -k is set 2015-04-23 10:37:37 +02:00
Jean-Francois Dockes
cd892ee1a7 usemtime config variable needs to be global 2014-12-09 15:58:23 +01:00
Jean-Francois Dockes
d630cbbaec Delete RCL_USE_XATTR configure/compile time variable, it was not 
useful. Add configuration variable to use mtime instead of ctime for update
detection. Useful on a system where xattrs would be modified but not
indexed, to avoid excessive reindexing.
 2014-12-09 11:15:17 +01:00
Jean-Francois Dockes
9346c4db9c fsindexer: avoid generating an empty bogus document when getting a subdoc error after the base doc has been seen 2014-10-29 08:18:20 +01:00
Jean-Francois Dockes
bba7875a10 Defining a topdir under a skippedPath is allowed and usefully works with normal indexing. This change fixes a bug which prevented it from working with the real-time monitor and recollindex -i 2014-10-10 10:17:57 +02:00
Jean-Francois Dockes
368ebf2f86 All docs get containerfilename field, indexed exclusively with prefix (only a field search containerfilename:someterm can match). 2014-07-23 19:30:41 +02:00
Jean-Francois Dockes
088f1f9a9f try out modification to use container file name for display, but not search, purposes when the subdocument file name is not set 2014-07-16 17:05:26 +02:00
Jean-Francois Dockes
cc052a31f8 don't add the top container file name to the subdocs terms 2014-06-12 14:17:18 +02:00
Jean-Francois Dockes
e867f855ad get rid of numerous probably inocuous valgrind/helgrind messages by ensuring that actual string copies are passed between threads, without refcount/shared data magic 2014-05-05 19:01:58 +02:00
Jean-Francois Dockes
56a56500c1 Handle partial indexing of document restricted to metadata from extended attributes 2013-10-04 10:57:11 +02:00
Jean-Francois Dockes
f49264a3f5 message 2013-09-27 13:04:23 +02:00
Jean-Francois Dockes
9cb5371820 get rid of the OFFTPC nonsense and cast to long long use lld to print off_t 2013-09-26 14:35:50 +02:00
medoc
641acd3d68 move the execution of external metadata-gathering commands from fsindexer to internfile for consistency of handling with filter-generated metadata 2013-09-06 11:51:00 +02:00
Jean-Francois Dockes
2b80c77c23 Add possibility to display a list of sub-documents for a given result 2013-04-24 16:33:53 +02:00
Jean-Francois Dockes
906e58feff added code to purge obsolete messages when a compound document (esp. mbox) is shortened and a partial update is performed (no general purge). Else the orphan docs remained in the index potentially forever (needed actual reindex of the file by a full pass to go away) 2013-04-22 11:32:49 +02:00
Jean-Francois Dockes
f05cae7344 arrange so that a default first indexing run for a given user runs a quick shallow pass, so that queries return some results quickly after indexing starts, avoiding user frustration 2013-04-18 14:29:32 +02:00
Jean-Francois Dockes
a74d885309 use st_ctime always to detect file changes 2013-03-31 08:36:11 +02:00
Jean-Francois Dockes
3736c00a3b more small fnmatch() fixes 2013-03-27 16:56:54 +01:00
Jean-Francois Dockes
3c80e51940 simplified temp file handling for compressed documents and, for querying, implemented caching for last file uncompressed 2013-03-06 18:52:57 +01:00
Jean-Francois Dockes
d3631b5ddf cleaned up processing of metadata from diverse origins (doc,extattrs,localfields) 2013-01-29 14:33:57 +01:00