407 Commits

Author SHA1 Message Date
Jean-Francois Dockes
3c8c8982e8 abstract: ensure snippet does not extend below baseTextPosition, this prevents retrieving page numbers. 2013-02-26 10:40:47 +01:00
Jean-Francois Dockes
af8b82332e minor opt: avoid walking allterms if not needed: no stemlangs + stripchars 2013-02-19 16:11:15 +01:00
Jean-Francois Dockes
2e2eeb70fb For case-sensitive indexes, wildcard expansion was not performed correctly for lowercase terms if no upped/mixed case version existed 2013-02-16 16:44:14 +01:00
Jean-Francois Dockes
d3631b5ddf cleaned up processing of metadata from diverse origins (doc,extattrs,localfields) 2013-01-29 14:33:57 +01:00
Jean-Francois Dockes
fe2f32fc38 split the term expansion code out of rcldb.cpp 2013-01-15 10:06:24 +01:00
Jean-Francois Dockes
d9e6030b66 reorganized the term expansion code so that the term explorer works fully with case and diac sensitivity options 2013-01-14 18:06:48 +01:00
Jean-Francois Dockes
f8280c88ca small fixups and compilation issues 2013-01-14 09:57:04 +01:00
Jean-Francois Dockes
6cc58881ad comments 2013-01-13 09:08:05 +01:00
Jean-Francois Dockes
f83ffd4518 missinginclude 2013-01-13 09:05:33 +01:00
Jean-Francois Dockes
8dc1177fd4 edit 2013-01-11 17:58:23 +01:00
Jean-Francois Dockes
29d4d959a5 Add db stats option to term explorer 2013-01-10 15:12:43 +01:00
Jean-Francois Dockes
1b38c5c98c replaced SCLT_EXCL clauses with general excl/neg flag 2013-01-05 18:15:54 +01:00
Jean-Francois Dockes
cbc269abb1 define new searchdataclausepath to replace the old dir: filtering mechanism. ORing dirs now works 2013-01-05 16:21:30 +01:00
Jean-Francois Dockes
9b55eb1cda perform case/diac expansion when processing wildcards 2013-01-04 13:34:26 +01:00
Jean-Francois Dockes
e1276f5d98 comments 2013-01-04 11:57:03 +01:00
Jean-Francois Dockes
69aa57d182 wild/reg spe chars defs moved to cstr 2013-01-04 10:06:08 +01:00
Jean-Francois Dockes
edb1bb5eb1 protect the xrdb from multiple accesses from needupdate tests and write thread 2013-01-01 16:20:06 +01:00
Jean-Francois Dockes
d2f7f11715 Use dynamic lib for shared recoll code 2012-12-29 14:27:01 +01:00
Jean-Francois Dockes
1384cd3d05 m_havewriteq was not always initialized, resulting in stray flush call 2012-12-28 16:34:15 +01:00
Jean-Francois Dockes
a9599be5f9 make sure that sort by field "relevancyrating" is equivalent to natural Xapian ordering 2012-12-19 19:59:06 +01:00
Jean-Francois Dockes
9561309f0b make ugroups a real vector of vectors (the previous "vectors" had only one entry with the user string even if it was made of several words) 2012-12-19 19:57:12 +01:00
Jean-Francois Dockes
3ed10ad122 comment 2012-12-19 19:56:03 +01:00
Jean-Francois Dockes
179d22f4ff added method to Rcl::Query for retrieving ref to SearchData + misc rclquery cleanup 2012-12-19 10:33:27 +01:00
Jean-Francois Dockes
c6b90a0a78 trace 2012-12-18 16:44:40 +01:00
Jean-Francois Dockes
4c950fd6f8 better stats in workqueue 2012-12-03 19:11:59 +01:00
Jean-Francois Dockes
5ebc277114 fix no threads compile 2012-12-02 14:47:06 +01:00
Jean-Francois Dockes
4afde68f9e more config isolation. Still crashing 2012-11-30 16:45:02 +01:00
Jean-Francois Dockes
3a33a68e2d Use PTMutexLocker in workqueue, and make it restartable 2012-11-30 07:35:03 +01:00
Jean-Francois Dockes
9146929f5e implemented configuration for thread structure. Still crashes, but not often... 2012-11-29 17:26:48 +01:00
Jean-Francois Dockes
5c6db5331c use const rclconfig 2012-11-28 13:20:52 +01:00
Jean-Francois Dockes
f252050247 ensure that indexing threads operations are transparent to high level callers such as the real time monitor 2012-11-26 15:40:31 +01:00
Jean-Francois Dockes
9ba04fc9c7 timing and traces 2012-11-26 09:16:06 +01:00
Jean-Francois Dockes
7115be2440 stemdb: only need to expand the unac'd term if it differs from raw + comments and traces 2012-11-26 09:13:57 +01:00
Jean-Francois Dockes
cc79ee3f73 threads: added recoll_threadinit calls to block signals 2012-11-23 13:36:05 +01:00
Jean-Francois Dockes
48deb73c43 add "soft" term expansion limit not causing error when reached 2012-11-18 17:28:49 +01:00
Jean-Francois Dockes
881794ce2b simplified and dispatched code in the searchdata monster 2012-11-18 13:25:54 +01:00
Jean-Francois Dockes
cb167cab0a none 2012-11-18 11:55:54 +01:00
Jean-Francois Dockes
657c65d438 Prevent error caused by trying to add a posting for an empty term (created by unac on really weird data) 2012-11-16 17:41:14 +01:00
Jean-Francois Dockes
9949952501 Raw dbs: do not skip diacritics and case expansion for terms which do not look like like natural language words (and for which stemming is skipped) 2012-11-16 13:15:58 +01:00
Jean-Francois Dockes
cd53c0a536 Multithreaded indexing seems not to crash anymore thanks to locked existence map 2012-11-02 21:43:51 +01:00
Jean-Francois Dockes
3d59c6933a comments 2012-11-02 11:37:23 +01:00
Jean-Francois Dockes
ee7d0f2ee7 1st parallel multithreaded version of indexing which can do my home without crashing... Let's checkpoint 2012-11-01 11:19:48 +01:00
Jean-Francois Dockes
5f0e348216 dont generate error for empty abstract this is a problem for python 2012-10-21 17:57:08 +02:00
Jean-Francois Dockes
2972ebc222 get the kio to build (and works on suse12.2) + compiler warnings 2012-10-18 14:42:25 +02:00
Jean-Francois Dockes
2ad6e2490a stray virtual 2012-10-17 17:53:33 +02:00
Jean-Francois Dockes
816980a1c4 implemented advanced search history feature 2012-10-16 13:37:56 +02:00
Jean-Francois Dockes
9ccb862666 fix prefix stripping in maxYearSpan 2012-10-16 13:36:54 +02:00
Jean-Francois Dockes
075f1f7518 filenames used for "filename search" need to be lowercased and stripped 2012-10-15 08:06:04 +02:00
Jean-Francois Dockes
bfeb681574 mimetype T prefix was mishandled for a raw index 2012-10-13 11:08:53 +02:00
Jean-Francois Dockes
3a2b15da10 comment 2012-10-12 13:36:38 +02:00