58 Commits

Author SHA1 Message Date
freddii
89c7efe682 fixed typos 2021-02-04 17:12:22 +01:00
Jean-Francois Dockes
560041cab9 cleared out errant tabs 2020-05-30 15:54:49 +02:00
Jean-Francois Dockes
1243c30980 rcldb_p needs to include log.h if threads disabled 2019-11-25 09:58:26 +01:00
Jean-Francois Dockes
b914e1d5b9 Fix abstract building when additional indexes are built: the raw text must be fetched by get_metadata() from its own index, not the combined one 2019-03-20 10:57:05 +01:00
Jean-Francois Dockes
0cbc46732f Fixed the FSF address 2019-03-04 11:19:14 +01:00
Jean-Francois Dockes
b079f0fb94 adjust log message levels and fix a warning 2019-02-04 11:42:35 +01:00
Jean-Francois Dockes
399c633efd Avoid purging documents from absent mountable volumes 2019-02-03 18:51:52 +01:00
Jean-Francois Dockes
a16e39a92b improve readability by fixing LOG statements and using auto and range-fors 2019-02-03 12:31:42 +01:00
Jean-Francois Dockes
dcd517bcf2 Fix -z always resetting index to non-text-storing independantly of configuration 2019-01-29 20:11:43 +01:00
Jean-Francois Dockes
3d4fd3c62e When storing doc text, always use a metadata entry. Get rid of the code to
store it in the data record. Make storing the default.  Add "fetchtext"
parameter to getDoc() to fetch and store the text in doc.text. Make this
accessible from Python. Misc comments and indents.
2018-01-25 13:20:02 +01:00
Jean-Francois Dockes
595e419d93 Implemented range queries, based on storing fields in xapian values 2018-01-24 09:43:20 +01:00
Jean-Francois Dockes
60cb39c935 indexStoreDocText config variable, fix terms and conditions when we store the doc text or not 2018-01-19 12:02:12 +01:00
Jean-Francois Dockes
2c76a70c0e Abstracts: storing raw doc text in user metadata records 2018-01-06 11:38:24 +01:00
Jean-Francois Dockes
b4493ed9e1 Snippets generation: add method for generating from doc stored text. Still needs refining, esp. for phrase/near 2017-12-30 08:43:14 +01:00
Jean-Francois Dockes
c1fad4afc7 Replaced pthread with std:: thread and mutex 2016-07-12 18:08:21 +02:00
Jean-Francois Dockes
f6a999de84 logging now uses c++ streams 2016-07-12 09:41:04 +02:00
Jean-Francois Dockes
14c8e740d6 Windows: fixed a number of int size warnings mostly by casting them away
--HG--
branch : WINDOWSPORT
2015-08-30 17:30:31 +02:00
Jean-Francois Dockes
e867f855ad get rid of numerous probably inocuous valgrind/helgrind messages by ensuring that actual string copies are passed between threads, without refcount/shared data magic 2014-05-05 19:01:58 +02:00
Jean-Francois Dockes
deb4cc8d12 mt indexing: do not pass copies of Xapian::Document between threads: the reference counting is not mt-safe. Replace with pointers 2014-05-05 10:59:50 +02:00
Jean-Francois Dockes
56a56500c1 Handle partial indexing of document restricted to metadata from extended attributes 2013-10-04 10:57:11 +02:00
Jean-Francois Dockes
334e16bee5 comments 2013-09-29 18:29:53 +02:00
Jean-Francois Dockes
a1b7018cfd Fix problems which occurred when using functions like open-parents with multiple indexes containing identical paths (udis) 2013-05-25 11:26:57 +02:00
Jean-Francois Dockes
e6402efbfb always set the "haspages" flags when reading doc from index so that the Snippets link can be set even if no abstract is computed 2013-05-22 13:24:31 +02:00
Jean-Francois Dockes
2b80c77c23 Add possibility to display a list of sub-documents for a given result 2013-04-24 16:33:53 +02:00
Jean-Francois Dockes
fc4adfdbaa moved code around 2013-04-22 17:30:11 +02:00
Jean-Francois Dockes
906e58feff added code to purge obsolete messages when a compound document (esp. mbox) is shortened and a partial update is performed (no general purge). Else the orphan docs remained in the index potentially forever (needed actual reindex of the file by a full pass to go away) 2013-04-22 11:32:49 +02:00
Jean-Francois Dockes
1384cd3d05 m_havewriteq was not always initialized, resulting in stray flush call 2012-12-28 16:34:15 +01:00
Jean-Francois Dockes
9146929f5e implemented configuration for thread structure. Still crashes, but not often... 2012-11-29 17:26:48 +01:00
Jean-Francois Dockes
f252050247 ensure that indexing threads operations are transparent to high level callers such as the real time monitor 2012-11-26 15:40:31 +01:00
Jean-Francois Dockes
9ba04fc9c7 timing and traces 2012-11-26 09:16:06 +01:00
Jean-Francois Dockes
cd53c0a536 Multithreaded indexing seems not to crash anymore thanks to locked existence map 2012-11-02 21:43:51 +01:00
Jean-Francois Dockes
ee7d0f2ee7 1st parallel multithreaded version of indexing which can do my home without crashing... Let's checkpoint 2012-11-01 11:19:48 +01:00
"Jean-Francois Dockes ext:(%22)
af2d031e50 moved snippets generation code from db to query object 2012-09-26 12:13:40 +02:00
"Jean-Francois Dockes ext:(%22)
52bc9f4aa3 merged the case/diac sensitivity code back into trunk 2012-09-25 19:20:24 +02:00
"Jean-Francois Dockes ext:(%22)
ab32062fcc Separate count and context for snippets in the snippets popup from the default values for the result list 2012-09-23 18:19:43 +02:00
Jean-Francois Dockes
d9dc7cf142 preliminary implementation for the snippets "open to page" popup window 2012-09-20 13:51:40 +02:00
Jean-Francois Dockes
a7222d4f96 Make Recoll optionally sensitive to case and diacritics
--HG--
branch : CASEDIACSENS
2012-09-14 14:34:27 +02:00
Jean-Francois Dockes
3dfaa7525b Display page numbers inside abstracts when possible (e.g.: for pdfs) 2012-09-11 12:44:40 +02:00
Jean-Francois Dockes
9327527101 small code reorg 2012-08-25 19:08:42 +02:00
Jean-Francois Dockes
bd0f002c1a Reimplemented the stem expansion mechanism over Xapian synonyms feature 2012-08-25 11:12:36 +02:00
"Jean-Francois Dockes ext:(%22)
0ebfc496d8 add capability to remember page breaks generated by, e.g. pdftotext, and use them to start an external viewer on a match page 2012-08-21 15:03:02 +02:00
Jean-Francois Dockes
7ddbbb1ee8 search language: implemented filtering on file size 2012-03-07 17:08:22 +01:00
Jean-Francois Dockes
25a99a3b38 add omega-compatible value slot for file size 2012-03-06 07:28:18 +01:00
Jean-Francois Dockes
9bc2fc8958 Experimented with multithreading the indexing pipeline. Left undef'd as 15%-30% improvement of indexing time does not seem worth the complexity 2012-02-21 17:09:02 +01:00
Jean-Francois Dockes
469c544915 GUI: allow setting the snippet separator inside abstract (now a real html ellipsis by default) 2011-07-07 11:11:02 +02:00
Jean-Francois Dockes
32f4f7b6fc Fix a number of potential or actual static object initialization issues 2011-05-09 20:48:59 +02:00
Jean-Francois Dockes
b28eaf23fb Got rid of all the old RCS id strings 2011-04-27 08:22:17 +02:00
Jean-Francois Dockes
93fb51d59b query: add duplication indicator to relevancy rating 2011-01-17 16:04:07 +01:00
Jean-Francois Dockes
3bd39d893e Gui restable: add/remove columns 2010-12-24 15:48:44 +01:00
dockes
709be40f5c unified retrying for databaseModified errors 2009-10-24 15:02:49 +00:00