562 Commits

Author SHA1 Message Date
Jean-Francois Dockes
b079f0fb94 adjust log message levels and fix a warning 2019-02-04 11:42:35 +01:00
Jean-Francois Dockes
399c633efd Avoid purging documents from absent mountable volumes 2019-02-03 18:51:52 +01:00
Jean-Francois Dockes
a16e39a92b improve readability by fixing LOG statements and using auto and range-fors 2019-02-03 12:31:42 +01:00
Jean-Francois Dockes
04f3449f99 Avoid multiple expansion of xapian term iterator 2019-02-01 09:07:28 +01:00
Jean-Francois Dockes
2909eec062 get rid of redundant rclversion.h 2019-01-30 12:40:55 +01:00
Jean-Francois Dockes
dcd517bcf2 Fix -z always resetting index to non-text-storing independantly of configuration 2019-01-29 20:11:43 +01:00
Jean-Francois Dockes
b62478c0cc Indent + comments + use c++11 loops 2018-11-14 10:38:22 +01:00
Jean-Francois Dockes
ea999ed6e5 Indent + comments + use c++11 initializers 2018-11-14 10:30:31 +01:00
Jean-Francois Dockes
036e1da6b4 rcldb: change flush log message level to INF 2018-11-14 09:42:22 +01:00
Jean-Francois Dockes
3ff88a9541 suppress query time updated map spurious error message 2018-10-07 09:07:51 +02:00
Jean-Francois Dockes
8358742132 get things to build on centos7.5 (cosmetic changes) 2018-09-02 18:47:03 +02:00
Jean-Francois Dockes
6441eea8aa Store the origin dbdir inside the GUI doc history, so we can later fetch documents from external indexes 2018-05-31 15:01:17 +02:00
Jean-Francois Dockes
ea3bd23d7c Fixed namespace decls issues 2018-04-18 09:34:58 +02:00
Jean-Francois Dockes
84abb8ac04 Fix regex used for cleaning up snippets 2018-04-12 12:25:05 +02:00
Jean-Francois Dockes
e4e5ee35d6 cleanup repeated punctuation in snippets 2018-04-10 13:07:27 +02:00
Jean-Francois Dockes
3168ba1082 log message 2018-04-10 10:31:24 +02:00
Jean-Francois Dockes
21adaca229 Add parameter to truncate all document text to specified length 2018-04-08 10:54:09 +02:00
Jean-Francois Dockes
7b83438e9c fix the ifdef condition for not trying to create a stretch db 2018-02-05 15:30:34 +01:00
Jean-Francois Dockes
cecd1b4ba7 Merge 1.23 Windows changes intended to improve the index rebuild failures caused by open files 2018-01-25 15:34:27 +01:00
Jean-Francois Dockes
3d4fd3c62e When storing doc text, always use a metadata entry. Get rid of the code to
store it in the data record. Make storing the default.  Add "fetchtext"
parameter to getDoc() to fetch and store the text in doc.text. Make this
accessible from Python. Misc comments and indents.
2018-01-25 13:20:02 +01:00
Jean-Francois Dockes
8b60cffa65 ranges: lowercase as needed when indexing 2018-01-24 15:58:50 +01:00
Jean-Francois Dockes
595e419d93 Implemented range queries, based on storing fields in xapian values 2018-01-24 09:43:20 +01:00
Jean-Francois Dockes
fd32872218 Improve 'rebuild index' under Windows: this often failed because of some
open files in the Xapian db (could not be deleted under windows).
Now only fails if a preview has been opened, and a GUI restart fixes the
situation.
2018-01-20 11:59:00 +01:00
Jean-Francois Dockes
5b35ecfe36 Windows warning suppression (no real changes) 2018-01-19 17:26:43 +01:00
Jean-Francois Dockes
60cb39c935 indexStoreDocText config variable, fix terms and conditions when we store the doc text or not 2018-01-19 12:02:12 +01:00
Jean-Francois Dockes
3d22f2c436 Merge branch 'RECOLL_1_23_MAINT' 2018-01-08 14:30:30 +01:00
Jean-Francois Dockes
e39b27e920 Dir filtering: would miss results if the filtered-for directory was partly upper-case and had a lower-case quasi-homonym 2018-01-08 14:19:48 +01:00
Jean-Francois Dockes
2c76a70c0e Abstracts: storing raw doc text in user metadata records 2018-01-06 11:38:24 +01:00
Jean-Francois Dockes
57d9ece876 rclabsfromtext: do not add page numbers if there are no pages 2018-01-06 10:39:02 +01:00
Jean-Francois Dockes
3fd3505827 Make the test for detecting non-stripped index a bit more specific (look for ":T:" instead of just ":"). Some very old indexes appear to have some ":" characters in them 2018-01-04 10:04:12 +01:00
Jean-Francois Dockes
a35de1ef1e snippets: fix to the group matching code 2018-01-03 15:53:04 +01:00
Jean-Francois Dockes
567401233a Building abstract/snippets from the doc text: process phrase/group terms 2018-01-03 15:28:46 +01:00
Jean-Francois Dockes
bb810f9ceb Changed new param name storerawtext->storedoctext. + comments 2018-01-02 19:23:12 +01:00
Jean-Francois Dockes
b4493ed9e1 Snippets generation: add method for generating from doc stored text. Still needs refining, esp. for phrase/near 2017-12-30 08:43:14 +01:00
Jean-Francois Dockes
2210d49d3d indent 2017-12-28 14:38:01 +01:00
Jean-Francois Dockes
81c1713d93 Merge branch 'RECOLL_1_23_MAINT' 2017-12-21 11:57:26 +01:00
Jean-Francois Dockes
e204bf06f3 Force creating new indexes in Chert format even when running with Xapian 1.4 in order to avoid the issues with snippet generation caused by the Glass index format 2017-12-08 15:14:17 +01:00
Jean-Francois Dockes
207e3d5af7 rclabstract: fixed log call formats and indentation 2017-12-07 10:51:10 +01:00
Jean-Francois Dockes
653b1fb5a5 rclquery: fixed log call formats and indentation 2017-12-07 10:44:54 +01:00
Jean-Francois Dockes
503edd5a92 Add function to list failed files to the term explorer 2017-09-03 10:46:11 +02:00
Jean-Francois Dockes
16250f6096 fix log messages whitespace and line breaks 2017-06-05 14:31:08 +02:00
Jean-Francois Dockes
f853f39ef3 Partially revert change treating Katakana as words, going back to n-grams. Did not work well because of separator-less compounds mostly 2017-04-25 10:20:38 +02:00
Jean-Francois Dockes
91e66a13f9 Moved docsToPaths() method from confindexer to function in rcldoc to simplify linking. confindexer.o not in librecoll any more.+small std namespace fixes 2017-04-24 10:15:44 +02:00
Jean-Francois Dockes
fca5e19504 Remove 'prolounged sound mark' from the end of katakana words 2017-04-21 12:13:10 +02:00
Jean-Francois Dockes
9661a4431e wen 2017-04-18 14:39:12 +02:00
Jean-Francois Dockes
bde991c08a got rid of off_t 2017-02-28 20:36:01 +01:00
Jean-Francois Dockes
2cfb4f7e4c allow disabling storing an abstract made of the beginning of document by setting its length parameter to 0 2017-02-27 18:26:34 +01:00
Jean-Francois Dockes
13f489306d Search term did not get passed to viewer for the main page open link because of mysteriously lost line of code 2016-12-11 18:53:29 +01:00
Jean-Francois Dockes
525fff9120 Replace deprecated Xapian::Database::flush() with commit() (name change only) 2016-12-11 09:40:29 +01:00
Jean-Francois Dockes
5779786142 catch Xapian exception caused by bad stemming language. Check stemdb creation status and have recollindex exit in error if it failed 2016-09-16 12:21:18 +02:00