286 Commits

Author SHA1 Message Date
Jean-Francois Dockes
bba7875a10 Defining a topdir under a skippedPath is allowed and usefully works with normal indexing. This change fixes a bug which prevented it from working with the real-time monitor and recollindex -i 2014-10-10 10:17:57 +02:00
Jean-Francois Dockes
368ebf2f86 All docs get containerfilename field, indexed exclusively with prefix (only a field search containerfilename:someterm can match). 2014-07-23 19:30:41 +02:00
Jean-Francois Dockes
46e924f3ea Allow configuration of the last-resort external command used to identify mime types 2014-07-19 16:15:43 +02:00
Jean-Francois Dockes
088f1f9a9f try out modification to use container file name for display, but not search, purposes when the subdocument file name is not set 2014-07-16 17:05:26 +02:00
Jean-Francois Dockes
bf9c813ec9 Web history indexing: fmtime was not saved to the cache, resulting in empty dates in queries 2014-07-08 15:06:47 +02:00
Jean-Francois Dockes
cc052a31f8 don't add the top container file name to the subdocs terms 2014-06-12 14:17:18 +02:00
Jean-Francois Dockes
e867f855ad get rid of numerous probably inocuous valgrind/helgrind messages by ensuring that actual string copies are passed between threads, without refcount/shared data magic 2014-05-05 19:01:58 +02:00
Jean-Francois Dockes
ed7a970ee6 recollindex: allow passing -e -i for erasing index data before rebuilding 2014-05-01 08:04:44 +02:00
Jean-Francois Dockes
7c9b13d64e recollindex -i or -e: do not process the web queue 2014-04-30 11:12:08 +02:00
Jean-Francois Dockes
00f9e37a1d message 2013-11-18 09:03:32 +01:00
Jean-Francois Dockes
a75d4c24ff fix multiple typos in commit 25c58c7/8ce2914 2013-10-29 08:36:14 +01:00
medoc
621c075820 look for the expedited indexing request file in all possible user configuration directories 2013-10-21 08:47:42 +02:00
Jean-Francois Dockes
6ddb0836c1 comment 2013-10-08 10:29:22 +02:00
Jean-Francois Dockes
56a56500c1 Handle partial indexing of document restricted to metadata from extended attributes 2013-10-04 10:57:11 +02:00
Jean-Francois Dockes
ccf175068b allow disabling the modif accumulation wait by creating a magic file 2013-09-30 18:43:15 +02:00
Jean-Francois Dockes
f49264a3f5 message 2013-09-27 13:04:23 +02:00
Jean-Francois Dockes
9cb5371820 get rid of the OFFTPC nonsense and cast to long long use lld to print off_t 2013-09-26 14:35:50 +02:00
medoc
641acd3d68 move the execution of external metadata-gathering commands from fsindexer to internfile for consistency of handling with filter-generated metadata 2013-09-06 11:51:00 +02:00
Jean-Francois Dockes
e515b9a9f9 Ignore empty mime_type extended attribute returned by bug in CIFS linux kernel module (samba mounts) 2013-06-17 11:52:04 +02:00
Jean-Francois Dockes
e77c510dfe Store original working directory before changing, for later turning user args into absolute paths 2013-06-06 14:05:26 +02:00
Jean-Francois Dockes
92331bfcbc added recursive reindex option to recollindex command line 2013-04-29 08:50:54 +02:00
Jean-Francois Dockes
555487ed98 none 2013-04-29 08:13:51 +02:00
Jean-Francois Dockes
62ca9549a3 fixed a few connections in subdocs aux reslist 2013-04-25 14:21:24 +02:00
Jean-Francois Dockes
2b80c77c23 Add possibility to display a list of sub-documents for a given result 2013-04-24 16:33:53 +02:00
Jean-Francois Dockes
906e58feff added code to purge obsolete messages when a compound document (esp. mbox) is shortened and a partial update is performed (no general purge). Else the orphan docs remained in the index potentially forever (needed actual reindex of the file by a full pass to go away) 2013-04-22 11:32:49 +02:00
Jean-Francois Dockes
f05cae7344 arrange so that a default first indexing run for a given user runs a quick shallow pass, so that queries return some results quickly after indexing starts, avoiding user frustration 2013-04-18 14:29:32 +02:00
Jean-Francois Dockes
caf5d105df Add support for indexing symlinks as such. Use inode/directory instead of application/x-fsdirectory as directory mime type. Fix stat/lstat usage in places (wipedir) 2013-04-17 18:34:02 +02:00
Jean-Francois Dockes
a74d885309 use st_ctime always to detect file changes 2013-03-31 08:36:11 +02:00
Jean-Francois Dockes
3736c00a3b more small fnmatch() fixes 2013-03-27 16:56:54 +01:00
Jean-Francois Dockes
4a870f984d Add parameter to chdir on recollindex startup, /tmp by default. Closes issue #129 2013-03-07 11:05:54 +01:00
Jean-Francois Dockes
3c80e51940 simplified temp file handling for compressed documents and, for querying, implemented caching for last file uncompressed 2013-03-06 18:52:57 +01:00
Jean-Francois Dockes
d3631b5ddf cleaned up processing of metadata from diverse origins (doc,extattrs,localfields) 2013-01-29 14:33:57 +01:00
Jean-Francois Dockes
e8afc66d8f fix compile issue with idxthreads enabled 2013-01-28 09:45:33 +01:00
Jean-Francois Dockes
6c4cdbb5d4 test "mime_type" extended attribute before trying other type recognition methods 2013-01-23 11:55:15 +01:00
Jean-Francois Dockes
4272939c3d add possibility to import tags from external app, e.g. tmsu 2013-01-22 18:30:18 +01:00
Jean-Francois Dockes
cbc269abb1 define new searchdataclausepath to replace the old dir: filtering mechanism. ORing dirs now works 2013-01-05 16:21:30 +01:00
Jean-Francois Dockes
49ce79d6a6 build with lib moved to recoll subdir works for debian 2012-12-30 16:11:51 +01:00
Jean-Francois Dockes
d2f7f11715 Use dynamic lib for shared recoll code 2012-12-29 14:27:01 +01:00
Jean-Francois Dockes
7ee94dbf3e traces 2012-12-28 16:31:10 +01:00
Jean-Francois Dockes
a0e273ddd4 Drain the job pipeline in fsindexer::purgefiles like was done in fsindexer::indexfiles as there is no warranty that the latter will be called before a db::close for each iteration of the monitor loop 2012-12-15 09:21:50 +01:00
Jean-Francois Dockes
72927b3fc8 additional cleanup after switch from .beagle to .recollweb 2012-12-14 13:20:09 +01:00
Jean-Francois Dockes
4afde68f9e more config isolation. Still crashing 2012-11-30 16:45:02 +01:00
Jean-Francois Dockes
3a33a68e2d Use PTMutexLocker in workqueue, and make it restartable 2012-11-30 07:35:03 +01:00
Jean-Francois Dockes
9146929f5e implemented configuration for thread structure. Still crashes, but not often... 2012-11-29 17:26:48 +01:00
Jean-Francois Dockes
f252050247 ensure that indexing threads operations are transparent to high level callers such as the real time monitor 2012-11-26 15:40:31 +01:00
Jean-Francois Dockes
9079258f91 Observe followSymlinks in indexfiles() 2012-11-26 09:14:51 +01:00
Jean-Francois Dockes
cc79ee3f73 threads: added recoll_threadinit calls to block signals 2012-11-23 13:36:05 +01:00
Jean-Francois Dockes
cd53c0a536 Multithreaded indexing seems not to crash anymore thanks to locked existence map 2012-11-02 21:43:51 +01:00
Jean-Francois Dockes
5fc8f240fe from 1.18 branch: Adjust things for using the new Firefox plugin: remove visible Beagle references + fix 1.18 web queue indexing bugs 2012-11-01 11:30:39 +01:00
Jean-Francois Dockes
ee7d0f2ee7 1st parallel multithreaded version of indexing which can do my home without crashing... Let's checkpoint 2012-11-01 11:19:48 +01:00