54 Commits

Author SHA1 Message Date
Jean-Francois Dockes
dd5cf808b5 mbox: trim verbosity 2019-09-23 09:26:19 +02:00
Jean-Francois Dockes
85a3291fd7 mbox: bad return from function would result in wrong (always first) message being previewed if the cache did not exist 2019-08-27 14:42:14 +02:00
Jean-Francois Dockes
54b8bea942 mbox: new std::stream-based implementation of offset cache ok on windows.. 2019-08-08 13:44:41 +02:00
Jean-Francois Dockes
ad5beb43c2 mh_mbox: fix on Windows.
The 2 main issues were that the files were fopen'd in text mode, and that
the std-based SimpleRegexp implementation was wrong (match instead of search).
Also, make sure that we are using 64 bits interfaces.
2019-08-07 17:07:06 +02:00
Jean-Francois Dockes
9a68157907 mh_mbox: improve diags for win debugging 2019-08-07 13:32:23 +02:00
Jean-Francois Dockes
0cbc46732f Fixed the FSF address 2019-03-04 11:19:14 +01:00
Jean-Francois Dockes
218b3fbfe2 Fix clear() call super antipattern in handlers 2018-11-14 15:29:07 +01:00
Jean-Francois Dockes
2267e5f2f5 Simplified code by replacing misc direct regex/regex.h invocation with SimpleRegex wrapper 2018-09-03 13:29:16 +02:00
Jean-Francois Dockes
9244e31574 fixed a few spelling errors, mostly in comments and debug messages 2018-05-03 16:20:36 +02:00
Jean-Francois Dockes
b55f4b3b0a add nomd5types parameter to set file types for which dedup is not that useful and computation is expensive (e.g. audio files). Replace "call parent" misfeature with call to virtual in MimeHandler constructor. Fix log calls indent 2017-02-02 18:09:00 +01:00
Jean-Francois Dockes
c1fad4afc7 Replaced pthread with std:: thread and mutex 2016-07-12 18:08:21 +02:00
Jean-Francois Dockes
f6a999de84 logging now uses c++ streams 2016-07-12 09:41:04 +02:00
Jean-Francois Dockes
f3820471e4 Add cachedir variable allowing to move all data directories by setting a single value. Closes issue #270 2016-04-08 15:09:15 +02:00
Jean-Francois Dockes
a95dcbd4b0 Windows: fix missing O_BINARY 2015-12-02 11:42:44 +01:00
Jean-Francois Dockes
5ba0be5e58 windows: mh_mbox reverted the test for From lines... 2015-12-01 17:29:44 +01:00
Jean-Francois Dockes
d942242047 replace all %lld instances 2015-10-03 17:25:17 +02:00
Jean-Francois Dockes
1cbf02f713 Suppressed many integer size warnings by a mix of type adjustments and casts,
none of which should have a real effect.

--HG--
branch : WINDOWSPORT
2015-09-01 19:39:20 +02:00
Jean-Francois Dockes
94da56aadc Handle windows paths: mostly change tests for relative, and some other tweaks.
--HG--
branch : WINDOWSPORT
2015-08-31 17:20:04 +02:00
Jean-Francois Dockes
3aeffea387 recollindex and recollq build and run but fail because of unac error
--HG--
branch : WINDOWSPORT
2015-08-31 13:08:50 +02:00
Jean-Francois Dockes
1d9047df1a fix linux build of windows branch
--HG--
branch : WINDOWSPORT
2015-08-30 15:50:17 +02:00
Jean-Francois Dockes
d4cd1dd91c 1st mods to get a build under windows. Does not build yet, far from it
--HG--
branch : WINDOWSPORT
2015-08-30 11:19:18 +02:00
Jean-Francois Dockes
62f4f7bd81 more safexx posix stuff 2015-08-22 08:37:58 +02:00
Jean-Francois Dockes
c6e228b7c6 Prepared windows port by removing a number of spurious reference to unix-specific interfaces, and using some xapian posix adaptor includes 2015-08-19 14:41:10 +02:00
Jean-Francois Dockes
3cceffdb9c Use O_NOATIME to avoid disturbing st_atime when possible. Closes issue #230 2015-03-25 13:49:33 +01:00
Jean-Francois Dockes
9ba0b3e8bc Replaced RSA md5 code with public domain OpenBSD/debian dpkg version 2015-03-01 14:28:01 +01:00
Jean-Francois Dockes
a7728ceb91 changed the mime handler cache key (was the mime type), to avoid having multiple copies of the same filter when applied to different mime types. This reduces a lot the number of processes during indexing, with no impact on performance 2013-04-25 18:18:48 +02:00
Jean-Francois Dockes
d942b44785 mbox: implement member size limit of 100MB and autodetec thunderbird mboxes (look for .msf) 2012-10-04 17:00:50 +02:00
Jean-Francois Dockes
0050f96f57 fix test driver 2012-03-18 08:23:33 +01:00
Jean-Francois Dockes
638d468796 clarified the use of string keys inside the Filter metaData array 2012-03-07 10:13:46 +01:00
Jean-Francois Dockes
38e0957962 const string cleanup 2011-10-01 16:39:38 +02:00
Jean-Francois Dockes
424e4173ba threading cleanup: add mutex protection around moronic change to transcode. Add mutex to equiv issue in unac. Rename const strings everywhere to cstr_xx to ease future detection of potentially problematic static variables. Most probably close issue #65 2011-09-28 15:01:14 +02:00
"Jean-Francois Dockes ext:(%22)
9cefcb7283 Simple optimization makes mh_mbox 3x faster 2011-08-20 14:54:29 +02:00
"Jean-Francois Dockes ext:(%22)
88685d2e64 search/index: fixed a number of bad conversions to properly deal with text documents bigger than 2GB 2011-07-12 08:28:09 -07:00
Jean-Francois Dockes
c45cdd7561 common data locking: remove deadlock in mbox cache locking 2011-04-28 14:28:19 +02:00
Jean-Francois Dockes
55f124725f Fix problems that occurred when multiple threads were trying to read/convert files at the same time (ie: indexing and previewing threads in the GUI calling internfile()). Either get rid of or lock-protect all shared data, eliminate misc initialization possible conflicts by using static initializers. Hopefuly closes issue #51 2011-04-28 10:58:33 +02:00
Jean-Francois Dockes
b28eaf23fb Got rid of all the old RCS id strings 2011-04-27 08:22:17 +02:00
Jean-Francois Dockes
e1a20aa810 got rid of accesses to global config through getMainConfig() 2011-03-02 13:47:07 +01:00
Jean-Francois Dockes
d80f4478fc Support thunderbird naked "^From $" separators 2011-01-11 18:36:40 +01:00
Jean-Francois Dockes
084740cd2b simplified the mbox-reading code 2010-11-30 15:21:44 +01:00
Jean-Francois Dockes
629e62e2b8 mbox: test driver improved 2010-11-30 11:35:21 +01:00
Jean-Francois Dockes
2f837a89b3 fix thunderbird hack breakage for 1,14,4 2010-11-29 22:43:41 +01:00
Jean-Francois Dockes
f10e14658f add quirks flag to handle bad thunderbird mbox formats 2010-11-22 16:25:25 +01:00
"Jean-Francois Dockes ext:(%22)
e5f41aeb05 Add large file support 2010-07-16 17:08:07 +02:00
Jean-Francois Dockes
b87a23bfca separated out the cache access part from beaglequeueindexer. this avoids having to link the pure query programs with indexing code 2010-02-05 12:46:41 +01:00
dockes
457e7d2e17 converted iostream to stdio because of mysterious read errors at the last position in the offsets file 2009-11-28 06:39:06 +00:00
dockes
17bcce5b98 include sys/stat 2009-11-27 13:08:50 +00:00
dockes
2ad0326ed7 implemented a cache for mbox message header offsets 2009-11-27 12:41:05 +00:00
dockes
d5c80cdf16 Support From "bla bla" (quoted) From lines 2009-11-27 07:07:38 +00:00
dockes
229645a0e2 added optional extended file attributes support 2009-01-21 13:55:12 +00:00
dockes
9082f3bf65 allow specifying format and charset for ext filters. Cache and reuse filters 2008-10-04 14:26:59 +00:00