tris/recoll
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
2,342 Commits 4 Branches 0 Tags
Commit Graph

210 Commits

Author SHA1 Message Date
Jean-Francois Dockes
9bc2fc8958 Experimented with multithreading the indexing pipeline. Left undef'd as 15%-30% improvement of indexing time does not seem worth the complexity 2012-02-21 17:09:02 +01:00
Jean-Francois Dockes
fccc0ac09c Get rid of the GUI indexing thread. All indexing now done by recollindex, with start/stop from the GUI 2012-02-07 17:07:07 +01:00
Jean-Francois Dockes
f59e2e033a index: update a status file while indexing 2012-02-06 17:03:39 +01:00
Jean-Francois Dockes
6b24c3df6b Add possibility to update the index for a list of files from the GUI and use it to allow updating the index before accessing a file using stale data 2012-02-03 15:51:03 +01:00
Jean-Francois Dockes
516863b5d6 GUI: perform up to date check before previewing a subdoc. This is for example to avoid showing the wrong message if a mail folder has been compacted 2012-01-20 17:48:55 +01:00
Jean-Francois Dockes
3853c5c0da Build the real-time monitor by default on FreeBSD (depend on USE_FAM). Fix a few glitches in the fam/gamin version 2011-10-14 14:06:24 +02:00
Jean-Francois Dockes
85191eba16 indexing could crash on different "file -i" output for some (binary) file names 2011-10-13 19:33:38 +02:00
Jean-Francois Dockes
e8f63ec124 The mime identification could potentially get a bad length exception while processing garbled "file" output 2011-10-13 16:38:26 +02:00
Jean-Francois Dockes
56fe54412f Protect against deadlock when using fam/gamin by adding a small timeout to the peek for events done between add calls. Add alarm to the addwatch call in case the deadlock happens anyway 2011-10-13 15:20:28 +02:00
Jean-Francois Dockes
b37ea1915a real time index: generate MODIFY event when receiving inotify MOVED_TO. We do not seem to receive a modify as was apparently the case at some point 2011-10-12 18:30:47 +02:00
Jean-Francois Dockes
61bf17aa46 moved routine around to avoid link issues 2011-10-06 13:48:57 +02:00
Jean-Francois Dockes
38e0957962 const string cleanup 2011-10-01 16:39:38 +02:00
Jean-Francois Dockes
e56b286f93 log 2011-09-30 16:19:42 +02:00
Jean-Francois Dockes
0c5f41c41c monitor: properly handle cleanup on directory moves 2011-09-30 08:56:29 +02:00
Jean-Francois Dockes
e0aa67f0dc let dir go through indexfiles() (name will be indexed, non recursive) 2011-09-30 08:44:50 +02:00
Jean-Francois Dockes
95995b7ff9 Indexing: have the indexer put itself in the ionice "idle" class by default (can be changed in the config) 2011-09-29 12:03:26 +02:00
Jean-Francois Dockes
424e4173ba threading cleanup: add mutex protection around moronic change to transcode. Add mutex to equiv issue in unac. Rename const strings everywhere to cstr_xx to ease future detection of potentially problematic static variables. Most probably close issue #65 2011-09-28 15:01:14 +02:00
Jean-Francois Dockes
5d0a22f5c3 monitor: perform doc deletes before updates. Start processing the queue as soon as it s big enough even if interval not expired 2011-09-03 10:39:11 +02:00
Jean-Francois Dockes
5c4f6e48a5 real time indexing: implement delaying for fast changing files 2011-08-01 14:52:21 +02:00
Jean-Francois Dockes
5ac07b20f6 rt monitor: make a copy of the config in the 2nd thread to avoid concurrent accesses (no reported bug on this, but could lead to a crash) 2011-08-01 13:59:01 +02:00
"Jean-Francois Dockes ext:(%22)
88685d2e64 search/index: fixed a number of bad conversions to properly deal with text documents bigger than 2GB 2011-07-12 08:28:09 -07:00
Jean-Francois Dockes
b6c73ecdeb debug: improve consistency of log messages about up to date/processed files 2011-06-04 10:18:46 +02:00
Jean-Francois Dockes
478fb84ec4 index: add recollindex -f option to ignore skippedPaths/Names when using recollindex -i. Allows arbitrary (non-recoll) path handling for skipped subtree 2011-05-15 22:19:55 +02:00
Jean-Francois Dockes
4869dfa775 real time indexing: also monitor x11 session health during the initial indexing pass 2011-04-28 15:15:16 +02:00
Jean-Francois Dockes
5d82b8652f improve acknowledgement of interrupt requests while starting monitor 2011-04-28 14:28:54 +02:00
Jean-Francois Dockes
a4d1689581 try to be more responsive to user interrupts: do not build the aux databases after an interruption, and check for an interruption during the purge pass 2011-04-28 12:27:06 +02:00
Jean-Francois Dockes
55f124725f Fix problems that occurred when multiple threads were trying to read/convert files at the same time (ie: indexing and previewing threads in the GUI calling internfile()). Either get rid of or lock-protect all shared data, eliminate misc initialization possible conflicts by using static initializers. Hopefuly closes issue #51 2011-04-28 10:58:33 +02:00
Jean-Francois Dockes
b28eaf23fb Got rid of all the old RCS id strings 2011-04-27 08:22:17 +02:00
Jean-Francois Dockes
f4c1c3678d indexing: an error on an archive member could crash or block the indexing because of the unclean way the ipath was passed in/out of internfile(). Closes issue #55 2011-04-25 16:41:43 +02:00
Jean-Francois Dockes
22788b8900 index: work around recent? gamin strangeness 2011-03-26 17:27:21 +01:00
Jean-Francois Dockes
bf120ca881 real time indexing: get rid of the rclmonpid lock file, now redundant with the general indexing lock 2011-03-04 10:17:09 +01:00
Jean-Francois Dockes
c4106ae0d9 indexing: use PRIO_PROCESS not PRIO_PGRP for setting recollindex nice value 2011-03-02 17:26:35 +01:00
Jean-Francois Dockes
e1a20aa810 got rid of accesses to global config through getMainConfig() 2011-03-02 13:47:07 +01:00
Jean-Francois Dockes
52fa332239 1.15.2 2011-02-14 20:30:34 +01:00
Jean-Francois Dockes
5fb98cd022 pid file: small compile fixes + rclmon.sh stop now works 2011-01-08 19:35:05 +01:00
Jean-Francois Dockes
166399fd62 indexing: create lock / pid file 2011-01-08 19:24:26 +01:00
Jean-Francois Dockes
28c8560200 comment 2010-12-14 18:19:08 +01:00
Jean-Francois Dockes
d72720d5eb real time indexer: call clearMimeHandlerCache at the end of indexfiles to get rid of filter subprocesses 2010-11-24 11:50:06 +01:00
Jean-Francois Dockes
34151006fe Index: add call to get rid of filter subprocesses at end of indexing (for the GUI thread) 2010-11-23 19:35:44 +01:00
Jean-Francois Dockes
6c03417195 Move locafields parsing code from fsindexer to rclconfig for possible reuse 2010-11-22 15:56:14 +01:00
Jean-Francois Dockes
98257f7066 Missing includes for gcc-4.4.5. Closes #34 2010-11-17 07:18:48 +01:00
Jean-Francois Dockes
061ffda545 checked/changed all sprintf calls 2010-11-15 11:57:39 +01:00
Jean-Francois Dockes
6e6a90d956 arrange to link additional libs needed by Xapian when doing a static build 2010-09-26 19:41:49 +02:00
Jean-Francois Dockes
d6cd7dad78 Include resource.h to use setpriority 2010-08-31 09:42:11 +02:00
"Jean-Francois Dockes ext:(%22)
6aeef686fc Created class to simplify temp directory management 2010-07-24 12:08:06 +02:00
"Jean-Francois Dockes ext:(%22)
846bec8a73 fix english indexation -> indexing 2010-07-20 09:48:20 +02:00
"Jean-Francois Dockes ext:(%22)
e5f41aeb05 Add large file support 2010-07-16 17:08:07 +02:00
Jean-Francois Dockes
1b8ce2fc72 restore indexallfilenames==0 function 2010-07-05 15:26:33 +02:00
Jean-Francois Dockes
a076380695 db parameter to BeagleQueueIndexer cant be null now that the cache access function has been extracted to BeagleQueueCache 2010-06-09 16:30:19 +02:00
Jean-Francois Dockes
73b6ebf300 simplify calls to update index status 2010-06-09 16:29:02 +02:00