29 Commits

Author SHA1 Message Date
Jean-Francois Dockes
a7728ceb91 changed the mime handler cache key (was the mime type), to avoid having multiple copies of the same filter when applied to different mime types. This reduces a lot the number of processes during indexing, with no impact on performance 2013-04-25 18:18:48 +02:00
Jean-Francois Dockes
d942b44785 mbox: implement member size limit of 100MB and autodetec thunderbird mboxes (look for .msf) 2012-10-04 17:00:50 +02:00
Jean-Francois Dockes
0050f96f57 fix test driver 2012-03-18 08:23:33 +01:00
Jean-Francois Dockes
638d468796 clarified the use of string keys inside the Filter metaData array 2012-03-07 10:13:46 +01:00
Jean-Francois Dockes
38e0957962 const string cleanup 2011-10-01 16:39:38 +02:00
Jean-Francois Dockes
424e4173ba threading cleanup: add mutex protection around moronic change to transcode. Add mutex to equiv issue in unac. Rename const strings everywhere to cstr_xx to ease future detection of potentially problematic static variables. Most probably close issue #65 2011-09-28 15:01:14 +02:00
"Jean-Francois Dockes ext:(%22)
9cefcb7283 Simple optimization makes mh_mbox 3x faster 2011-08-20 14:54:29 +02:00
"Jean-Francois Dockes ext:(%22)
88685d2e64 search/index: fixed a number of bad conversions to properly deal with text documents bigger than 2GB 2011-07-12 08:28:09 -07:00
Jean-Francois Dockes
c45cdd7561 common data locking: remove deadlock in mbox cache locking 2011-04-28 14:28:19 +02:00
Jean-Francois Dockes
55f124725f Fix problems that occurred when multiple threads were trying to read/convert files at the same time (ie: indexing and previewing threads in the GUI calling internfile()). Either get rid of or lock-protect all shared data, eliminate misc initialization possible conflicts by using static initializers. Hopefuly closes issue #51 2011-04-28 10:58:33 +02:00
Jean-Francois Dockes
b28eaf23fb Got rid of all the old RCS id strings 2011-04-27 08:22:17 +02:00
Jean-Francois Dockes
e1a20aa810 got rid of accesses to global config through getMainConfig() 2011-03-02 13:47:07 +01:00
Jean-Francois Dockes
d80f4478fc Support thunderbird naked "^From $" separators 2011-01-11 18:36:40 +01:00
Jean-Francois Dockes
084740cd2b simplified the mbox-reading code 2010-11-30 15:21:44 +01:00
Jean-Francois Dockes
629e62e2b8 mbox: test driver improved 2010-11-30 11:35:21 +01:00
Jean-Francois Dockes
2f837a89b3 fix thunderbird hack breakage for 1,14,4 2010-11-29 22:43:41 +01:00
Jean-Francois Dockes
f10e14658f add quirks flag to handle bad thunderbird mbox formats 2010-11-22 16:25:25 +01:00
"Jean-Francois Dockes ext:(%22)
e5f41aeb05 Add large file support 2010-07-16 17:08:07 +02:00
Jean-Francois Dockes
b87a23bfca separated out the cache access part from beaglequeueindexer. this avoids having to link the pure query programs with indexing code 2010-02-05 12:46:41 +01:00
dockes
457e7d2e17 converted iostream to stdio because of mysterious read errors at the last position in the offsets file 2009-11-28 06:39:06 +00:00
dockes
17bcce5b98 include sys/stat 2009-11-27 13:08:50 +00:00
dockes
2ad0326ed7 implemented a cache for mbox message header offsets 2009-11-27 12:41:05 +00:00
dockes
d5c80cdf16 Support From "bla bla" (quoted) From lines 2009-11-27 07:07:38 +00:00
dockes
229645a0e2 added optional extended file attributes support 2009-01-21 13:55:12 +00:00
dockes
9082f3bf65 allow specifying format and charset for ext filters. Cache and reuse filters 2008-10-04 14:26:59 +00:00
dockes
a8c96287cf accept weird date format in From lines used by (old?) tbird 2008-08-29 13:05:12 +00:00
dockes
46a7f05cbc gcc 4 compat, thanks to Kartik Mistry 2007-12-13 06:58:22 +00:00
dockes
013364faf5 Improve From_ line detection 2007-10-03 14:53:37 +00:00
dockes
33c95ef1ba Dijon filters 1st step: mostly working needs check and optim 2006-12-15 12:40:24 +00:00