Jean-Francois Dockes
d4cd1dd91c
1st mods to get a build under windows. Does not build yet, far from it
...
--HG--
branch : WINDOWSPORT
2015-08-30 11:19:18 +02:00
Jean-Francois Dockes
62f4f7bd81
more safexx posix stuff
2015-08-22 08:37:58 +02:00
Jean-Francois Dockes
c6e228b7c6
Prepared windows port by removing a number of spurious reference to unix-specific interfaces, and using some xapian posix adaptor includes
2015-08-19 14:41:10 +02:00
Jean-Francois Dockes
2c2f375a33
firstindexing was never run because the status file was trucated before it was tested for being not empty
2015-08-19 13:22:30 +02:00
Jean-Francois Dockes
4d1f679eac
Use std[::tr1]::shared_ptr instead of local RefCntr by default
2015-08-09 13:54:24 +02:00
Jean-Francois Dockes
1e2fdcd21d
other ut/test drivers Makefiles
2015-08-05 09:01:11 +02:00
Jean-Francois Dockes
4d35cbabfb
Also index non-html files from the web queue and fix the Open operation for them
2015-07-24 16:30:13 +02:00
Jean-Francois Dockes
c7f5318e43
config checking: only test skippedPaths existence for user-added values, not defaults
2015-06-08 13:20:06 +02:00
Jean-Francois Dockes
4989d1f991
Warn if config file contains non-existing paths. Fixes issue #244
2015-06-08 10:14:11 +02:00
Jean-Francois Dockes
d78b7069cc
Check that all topdirs elements are absolute paths
2015-05-07 08:19:25 +02:00
Jean-Francois Dockes
1e6f56522e
Let recollindex execute a script at startup to try and guess if it should retry failed files
2015-04-24 10:46:58 +02:00
Jean-Francois Dockes
e6c0ca403d
recollindex: do not retry files which previously failed to be indexed, except if they were changed since, or option -k is set
2015-04-23 10:37:37 +02:00
Jean-Francois Dockes
12d1de2e9e
Try to match as long a suffix as possible when determining MIME type. This will allow .tar.gz files to be indexed directly instead of being decompressed to a temp file first.
2015-04-16 19:52:04 +02:00
Jean-Francois Dockes
d10b557e4c
Use special case for indexing empty files
2015-04-16 19:49:40 +02:00
Jean-Francois Dockes
ce4405a666
make sure that CPPFLAGS CXXFLAGS and LDFLAGS are used during the build
2015-03-01 12:43:09 +01:00
Jean-Francois Dockes
811e02bf87
Revert change in indexfiles which was preventing the real time indexer from processing the web queue
2015-02-16 19:35:24 +01:00
Jean-Francois Dockes
727c055c86
web queue: fix cache resizing utility + bug in indexer which would skip oldest entry
2015-02-15 16:08:36 +01:00
Jean-Francois Dockes
cd892ee1a7
usemtime config variable needs to be global
2014-12-09 15:58:23 +01:00
Jean-Francois Dockes
d630cbbaec
Delete RCL_USE_XATTR configure/compile time variable, it was not
...
useful. Add configuration variable to use mtime instead of ctime for update
detection. Useful on a system where xattrs would be modified but not
indexed, to avoid excessive reindexing.
2014-12-09 11:15:17 +01:00
Jean-Francois Dockes
9346c4db9c
fsindexer: avoid generating an empty bogus document when getting a subdoc error after the base doc has been seen
2014-10-29 08:18:20 +01:00
Jean-Francois Dockes
bba7875a10
Defining a topdir under a skippedPath is allowed and usefully works with normal indexing. This change fixes a bug which prevented it from working with the real-time monitor and recollindex -i
2014-10-10 10:17:57 +02:00
Jean-Francois Dockes
368ebf2f86
All docs get containerfilename field, indexed exclusively with prefix (only a field search containerfilename:someterm can match).
2014-07-23 19:30:41 +02:00
Jean-Francois Dockes
46e924f3ea
Allow configuration of the last-resort external command used to identify mime types
2014-07-19 16:15:43 +02:00
Jean-Francois Dockes
088f1f9a9f
try out modification to use container file name for display, but not search, purposes when the subdocument file name is not set
2014-07-16 17:05:26 +02:00
Jean-Francois Dockes
bf9c813ec9
Web history indexing: fmtime was not saved to the cache, resulting in empty dates in queries
2014-07-08 15:06:47 +02:00
Jean-Francois Dockes
cc052a31f8
don't add the top container file name to the subdocs terms
2014-06-12 14:17:18 +02:00
Jean-Francois Dockes
e867f855ad
get rid of numerous probably inocuous valgrind/helgrind messages by ensuring that actual string copies are passed between threads, without refcount/shared data magic
2014-05-05 19:01:58 +02:00
Jean-Francois Dockes
ed7a970ee6
recollindex: allow passing -e -i for erasing index data before rebuilding
2014-05-01 08:04:44 +02:00
Jean-Francois Dockes
7c9b13d64e
recollindex -i or -e: do not process the web queue
2014-04-30 11:12:08 +02:00
Jean-Francois Dockes
00f9e37a1d
message
2013-11-18 09:03:32 +01:00
Jean-Francois Dockes
a75d4c24ff
fix multiple typos in commit 25c58c7/8ce2914
2013-10-29 08:36:14 +01:00
medoc
621c075820
look for the expedited indexing request file in all possible user configuration directories
2013-10-21 08:47:42 +02:00
Jean-Francois Dockes
6ddb0836c1
comment
2013-10-08 10:29:22 +02:00
Jean-Francois Dockes
56a56500c1
Handle partial indexing of document restricted to metadata from extended attributes
2013-10-04 10:57:11 +02:00
Jean-Francois Dockes
ccf175068b
allow disabling the modif accumulation wait by creating a magic file
2013-09-30 18:43:15 +02:00
Jean-Francois Dockes
f49264a3f5
message
2013-09-27 13:04:23 +02:00
Jean-Francois Dockes
9cb5371820
get rid of the OFFTPC nonsense and cast to long long use lld to print off_t
2013-09-26 14:35:50 +02:00
medoc
641acd3d68
move the execution of external metadata-gathering commands from fsindexer to internfile for consistency of handling with filter-generated metadata
2013-09-06 11:51:00 +02:00
Jean-Francois Dockes
e515b9a9f9
Ignore empty mime_type extended attribute returned by bug in CIFS linux kernel module (samba mounts)
2013-06-17 11:52:04 +02:00
Jean-Francois Dockes
e77c510dfe
Store original working directory before changing, for later turning user args into absolute paths
2013-06-06 14:05:26 +02:00
Jean-Francois Dockes
92331bfcbc
added recursive reindex option to recollindex command line
2013-04-29 08:50:54 +02:00
Jean-Francois Dockes
555487ed98
none
2013-04-29 08:13:51 +02:00
Jean-Francois Dockes
62ca9549a3
fixed a few connections in subdocs aux reslist
2013-04-25 14:21:24 +02:00
Jean-Francois Dockes
2b80c77c23
Add possibility to display a list of sub-documents for a given result
2013-04-24 16:33:53 +02:00
Jean-Francois Dockes
906e58feff
added code to purge obsolete messages when a compound document (esp. mbox) is shortened and a partial update is performed (no general purge). Else the orphan docs remained in the index potentially forever (needed actual reindex of the file by a full pass to go away)
2013-04-22 11:32:49 +02:00
Jean-Francois Dockes
f05cae7344
arrange so that a default first indexing run for a given user runs a quick shallow pass, so that queries return some results quickly after indexing starts, avoiding user frustration
2013-04-18 14:29:32 +02:00
Jean-Francois Dockes
caf5d105df
Add support for indexing symlinks as such. Use inode/directory instead of application/x-fsdirectory as directory mime type. Fix stat/lstat usage in places (wipedir)
2013-04-17 18:34:02 +02:00
Jean-Francois Dockes
a74d885309
use st_ctime always to detect file changes
2013-03-31 08:36:11 +02:00
Jean-Francois Dockes
3736c00a3b
more small fnmatch() fixes
2013-03-27 16:56:54 +01:00
Jean-Francois Dockes
4a870f984d
Add parameter to chdir on recollindex startup, /tmp by default. Closes issue #129
2013-03-07 11:05:54 +01:00
