415 Commits

Author SHA1 Message Date
Jean-Francois Dockes
3736c00a3b more small fnmatch() fixes 2013-03-27 16:56:54 +01:00
Jean-Francois Dockes
dd0e89e694 fnmatch() errors encountered with charset conversion errors on file names were treated as matches 2013-03-27 15:44:24 +01:00
Jean-Francois Dockes
6a4a385657 added basic facility for result path translation 2013-03-26 10:42:46 +01:00
Jean-Francois Dockes
a57b02bd09 wildcard-expand mime types against the index not the config 2013-03-04 14:44:04 +01:00
Jean-Francois Dockes
66a5d9ab83 Arrange things so that "open parent" selects the file child when the parent is a directory 2013-02-27 14:36:45 +01:00
Jean-Francois Dockes
66f7ac31eb dont use prefixed terms for looking for snippets. Reversible 2013-02-27 14:36:10 +01:00
Jean-Francois Dockes
3abfd00635 improved detection of incomplete snippets lists 2013-02-26 15:49:36 +01:00
Jean-Francois Dockes
87120798c2 actually implement maxTermExpand and maxXapianClauses and improve error message 2013-02-26 14:34:25 +01:00
Jean-Francois Dockes
3c8c8982e8 abstract: ensure snippet does not extend below baseTextPosition, this prevents retrieving page numbers. 2013-02-26 10:40:47 +01:00
Jean-Francois Dockes
af8b82332e minor opt: avoid walking allterms if not needed: no stemlangs + stripchars 2013-02-19 16:11:15 +01:00
Jean-Francois Dockes
2e2eeb70fb For case-sensitive indexes, wildcard expansion was not performed correctly for lowercase terms if no upped/mixed case version existed 2013-02-16 16:44:14 +01:00
Jean-Francois Dockes
d3631b5ddf cleaned up processing of metadata from diverse origins (doc,extattrs,localfields) 2013-01-29 14:33:57 +01:00
Jean-Francois Dockes
fe2f32fc38 split the term expansion code out of rcldb.cpp 2013-01-15 10:06:24 +01:00
Jean-Francois Dockes
d9e6030b66 reorganized the term expansion code so that the term explorer works fully with case and diac sensitivity options 2013-01-14 18:06:48 +01:00
Jean-Francois Dockes
f8280c88ca small fixups and compilation issues 2013-01-14 09:57:04 +01:00
Jean-Francois Dockes
6cc58881ad comments 2013-01-13 09:08:05 +01:00
Jean-Francois Dockes
f83ffd4518 missinginclude 2013-01-13 09:05:33 +01:00
Jean-Francois Dockes
8dc1177fd4 edit 2013-01-11 17:58:23 +01:00
Jean-Francois Dockes
29d4d959a5 Add db stats option to term explorer 2013-01-10 15:12:43 +01:00
Jean-Francois Dockes
1b38c5c98c replaced SCLT_EXCL clauses with general excl/neg flag 2013-01-05 18:15:54 +01:00
Jean-Francois Dockes
cbc269abb1 define new searchdataclausepath to replace the old dir: filtering mechanism. ORing dirs now works 2013-01-05 16:21:30 +01:00
Jean-Francois Dockes
9b55eb1cda perform case/diac expansion when processing wildcards 2013-01-04 13:34:26 +01:00
Jean-Francois Dockes
e1276f5d98 comments 2013-01-04 11:57:03 +01:00
Jean-Francois Dockes
69aa57d182 wild/reg spe chars defs moved to cstr 2013-01-04 10:06:08 +01:00
Jean-Francois Dockes
edb1bb5eb1 protect the xrdb from multiple accesses from needupdate tests and write thread 2013-01-01 16:20:06 +01:00
Jean-Francois Dockes
d2f7f11715 Use dynamic lib for shared recoll code 2012-12-29 14:27:01 +01:00
Jean-Francois Dockes
1384cd3d05 m_havewriteq was not always initialized, resulting in stray flush call 2012-12-28 16:34:15 +01:00
Jean-Francois Dockes
a9599be5f9 make sure that sort by field "relevancyrating" is equivalent to natural Xapian ordering 2012-12-19 19:59:06 +01:00
Jean-Francois Dockes
9561309f0b make ugroups a real vector of vectors (the previous "vectors" had only one entry with the user string even if it was made of several words) 2012-12-19 19:57:12 +01:00
Jean-Francois Dockes
3ed10ad122 comment 2012-12-19 19:56:03 +01:00
Jean-Francois Dockes
179d22f4ff added method to Rcl::Query for retrieving ref to SearchData + misc rclquery cleanup 2012-12-19 10:33:27 +01:00
Jean-Francois Dockes
c6b90a0a78 trace 2012-12-18 16:44:40 +01:00
Jean-Francois Dockes
4c950fd6f8 better stats in workqueue 2012-12-03 19:11:59 +01:00
Jean-Francois Dockes
5ebc277114 fix no threads compile 2012-12-02 14:47:06 +01:00
Jean-Francois Dockes
4afde68f9e more config isolation. Still crashing 2012-11-30 16:45:02 +01:00
Jean-Francois Dockes
3a33a68e2d Use PTMutexLocker in workqueue, and make it restartable 2012-11-30 07:35:03 +01:00
Jean-Francois Dockes
9146929f5e implemented configuration for thread structure. Still crashes, but not often... 2012-11-29 17:26:48 +01:00
Jean-Francois Dockes
5c6db5331c use const rclconfig 2012-11-28 13:20:52 +01:00
Jean-Francois Dockes
f252050247 ensure that indexing threads operations are transparent to high level callers such as the real time monitor 2012-11-26 15:40:31 +01:00
Jean-Francois Dockes
9ba04fc9c7 timing and traces 2012-11-26 09:16:06 +01:00
Jean-Francois Dockes
7115be2440 stemdb: only need to expand the unac'd term if it differs from raw + comments and traces 2012-11-26 09:13:57 +01:00
Jean-Francois Dockes
cc79ee3f73 threads: added recoll_threadinit calls to block signals 2012-11-23 13:36:05 +01:00
Jean-Francois Dockes
48deb73c43 add "soft" term expansion limit not causing error when reached 2012-11-18 17:28:49 +01:00
Jean-Francois Dockes
881794ce2b simplified and dispatched code in the searchdata monster 2012-11-18 13:25:54 +01:00
Jean-Francois Dockes
cb167cab0a none 2012-11-18 11:55:54 +01:00
Jean-Francois Dockes
657c65d438 Prevent error caused by trying to add a posting for an empty term (created by unac on really weird data) 2012-11-16 17:41:14 +01:00
Jean-Francois Dockes
9949952501 Raw dbs: do not skip diacritics and case expansion for terms which do not look like like natural language words (and for which stemming is skipped) 2012-11-16 13:15:58 +01:00
Jean-Francois Dockes
cd53c0a536 Multithreaded indexing seems not to crash anymore thanks to locked existence map 2012-11-02 21:43:51 +01:00
Jean-Francois Dockes
3d59c6933a comments 2012-11-02 11:37:23 +01:00
Jean-Francois Dockes
ee7d0f2ee7 1st parallel multithreaded version of indexing which can do my home without crashing... Let's checkpoint 2012-11-01 11:19:48 +01:00