234 Commits

Author SHA1 Message Date
Jean-Francois Dockes
2972ebc222 get the kio to build (and works on suse12.2) + compiler warnings 2012-10-18 14:42:25 +02:00
Jean-Francois Dockes
a7222d4f96 Make Recoll optionally sensitive to case and diacritics
--HG--
branch : CASEDIACSENS
2012-09-14 14:34:27 +02:00
Jean-Francois Dockes
8b40cb0499 merged from cdsens branch 2012-09-13 12:28:42 +02:00
Jean-Francois Dockes
e0bc65bfdd small mods inocuous or auxiliary to case/diac sensitivity but which can live in main branch 2012-09-13 12:25:01 +02:00
Jean-Francois Dockes
c030a15780 Remove improper assertion use from beagle cache handling code 2012-09-13 09:44:47 +02:00
Jean-Francois Dockes
776800f47a arrange to create all stem dicts in one pass 2012-08-28 13:39:34 +02:00
Jean-Francois Dockes
bd0f002c1a Reimplemented the stem expansion mechanism over Xapian synonyms feature 2012-08-25 11:12:36 +02:00
Jean-Francois Dockes
ee9dbda9fc comments doc and formatting 2012-08-24 10:26:16 +02:00
"Jean-Francois Dockes ext:(%22)
ec3dbb4092 comments 2012-08-21 08:38:23 +02:00
"Jean-Francois Dockes ext:(%22)
6eada80b08 allow multiple directory specs as in dir:/home/me -dir:tmp 2012-08-19 08:27:12 +02:00
Jean-Francois Dockes
83ea60484c dont terminate monitor for permission-related addwatch error 2012-08-14 08:15:49 +02:00
Jean-Francois Dockes
643f4d56bb internals: virtualized the doc fetcher interface 2012-06-05 07:16:11 +02:00
Jean-Francois Dockes
37b7ac93f5 typo in 2754:5a63b39e0c5a 2012-05-28 09:41:40 +02:00
Jean-Francois Dockes
ff9a4a2a92 indexing daemon: reexecute after the initial indexing pass to get rid of memory if it was heavy 2012-05-25 18:51:52 +02:00
Jean-Francois Dockes
8b34610dde Cleaned up file name handling. Fixes that file names were sometimes indexed split, sometimes not. They now always are both, with different prefixes. Forces reindex 2012-04-13 09:18:08 +02:00
Jean-Francois Dockes
4eaf12fb9c more delistification 2012-04-12 08:15:50 +02:00
Jean-Francois Dockes
ec7b40a52e cosmetics: list -> vector in more places 2012-04-11 19:58:08 +02:00
Jean-Francois Dockes
78bd8d63da use vector instead of list for execmd arg list 2012-04-11 15:36:49 +02:00
Jean-Francois Dockes
c7c9c49437 add -Z "in place reset" option to recollindex 2012-04-11 11:33:33 +02:00
Jean-Francois Dockes
9f402d33cb got rid of unused csguess module 2012-04-06 15:14:01 +02:00
Jean-Francois Dockes
85166c93b2 Changed the way we handle document sizes. The fbytes field should now be in most cases the most "natural" document size. pcbytes holds the top external container size and dbytes the text size 2012-03-07 15:39:30 +01:00
Jean-Francois Dockes
638d468796 clarified the use of string keys inside the Filter metaData array 2012-03-07 10:13:46 +01:00
Jean-Francois Dockes
2c6b023a88 real time indexer: monitor the configuration for changes and reexecute when needed 2012-03-06 09:35:21 +01:00
Jean-Francois Dockes
7ce1a5f2e4 real time index: dont generate events for skipped files. They would have been filtered later on, but this avoids repeatedly awaking the main thread and opening/closing the index because of events on ever changing files like the infamous .xsession-errors 2012-03-06 07:42:40 +01:00
Jean-Francois Dockes
9bc2fc8958 Experimented with multithreading the indexing pipeline. Left undef'd as 15%-30% improvement of indexing time does not seem worth the complexity 2012-02-21 17:09:02 +01:00
Jean-Francois Dockes
fccc0ac09c Get rid of the GUI indexing thread. All indexing now done by recollindex, with start/stop from the GUI 2012-02-07 17:07:07 +01:00
Jean-Francois Dockes
f59e2e033a index: update a status file while indexing 2012-02-06 17:03:39 +01:00
Jean-Francois Dockes
6b24c3df6b Add possibility to update the index for a list of files from the GUI and use it to allow updating the index before accessing a file using stale data 2012-02-03 15:51:03 +01:00
Jean-Francois Dockes
516863b5d6 GUI: perform up to date check before previewing a subdoc. This is for example to avoid showing the wrong message if a mail folder has been compacted 2012-01-20 17:48:55 +01:00
Jean-Francois Dockes
3853c5c0da Build the real-time monitor by default on FreeBSD (depend on USE_FAM). Fix a few glitches in the fam/gamin version 2011-10-14 14:06:24 +02:00
Jean-Francois Dockes
85191eba16 indexing could crash on different "file -i" output for some (binary) file names 2011-10-13 19:33:38 +02:00
Jean-Francois Dockes
e8f63ec124 The mime identification could potentially get a bad length exception while processing garbled "file" output 2011-10-13 16:38:26 +02:00
Jean-Francois Dockes
56fe54412f Protect against deadlock when using fam/gamin by adding a small timeout to the peek for events done between add calls. Add alarm to the addwatch call in case the deadlock happens anyway 2011-10-13 15:20:28 +02:00
Jean-Francois Dockes
b37ea1915a real time index: generate MODIFY event when receiving inotify MOVED_TO. We do not seem to receive a modify as was apparently the case at some point 2011-10-12 18:30:47 +02:00
Jean-Francois Dockes
61bf17aa46 moved routine around to avoid link issues 2011-10-06 13:48:57 +02:00
Jean-Francois Dockes
38e0957962 const string cleanup 2011-10-01 16:39:38 +02:00
Jean-Francois Dockes
e56b286f93 log 2011-09-30 16:19:42 +02:00
Jean-Francois Dockes
0c5f41c41c monitor: properly handle cleanup on directory moves 2011-09-30 08:56:29 +02:00
Jean-Francois Dockes
e0aa67f0dc let dir go through indexfiles() (name will be indexed, non recursive) 2011-09-30 08:44:50 +02:00
Jean-Francois Dockes
95995b7ff9 Indexing: have the indexer put itself in the ionice "idle" class by default (can be changed in the config) 2011-09-29 12:03:26 +02:00
Jean-Francois Dockes
424e4173ba threading cleanup: add mutex protection around moronic change to transcode. Add mutex to equiv issue in unac. Rename const strings everywhere to cstr_xx to ease future detection of potentially problematic static variables. Most probably close issue #65 2011-09-28 15:01:14 +02:00
Jean-Francois Dockes
5d0a22f5c3 monitor: perform doc deletes before updates. Start processing the queue as soon as it s big enough even if interval not expired 2011-09-03 10:39:11 +02:00
Jean-Francois Dockes
5c4f6e48a5 real time indexing: implement delaying for fast changing files 2011-08-01 14:52:21 +02:00
Jean-Francois Dockes
5ac07b20f6 rt monitor: make a copy of the config in the 2nd thread to avoid concurrent accesses (no reported bug on this, but could lead to a crash) 2011-08-01 13:59:01 +02:00
"Jean-Francois Dockes ext:(%22)
88685d2e64 search/index: fixed a number of bad conversions to properly deal with text documents bigger than 2GB 2011-07-12 08:28:09 -07:00
Jean-Francois Dockes
b6c73ecdeb debug: improve consistency of log messages about up to date/processed files 2011-06-04 10:18:46 +02:00
Jean-Francois Dockes
478fb84ec4 index: add recollindex -f option to ignore skippedPaths/Names when using recollindex -i. Allows arbitrary (non-recoll) path handling for skipped subtree 2011-05-15 22:19:55 +02:00
Jean-Francois Dockes
4869dfa775 real time indexing: also monitor x11 session health during the initial indexing pass 2011-04-28 15:15:16 +02:00
Jean-Francois Dockes
5d82b8652f improve acknowledgement of interrupt requests while starting monitor 2011-04-28 14:28:54 +02:00
Jean-Francois Dockes
a4d1689581 try to be more responsive to user interrupts: do not build the aux databases after an interruption, and check for an interruption during the purge pass 2011-04-28 12:27:06 +02:00