Anders S. Mortensen [Thu, 20 Dec 2007 11:44:18 +0000 (11:44 +0000)]
Now supporting melm too.
Adam Dickmeiss [Thu, 20 Dec 2007 11:21:29 +0000 (11:21 +0000)]
Changed log message for adelete action
Adam Dickmeiss [Thu, 20 Dec 2007 11:15:41 +0000 (11:15 +0000)]
Implemented update action : adelete.
New action action_delete added. zebra_extract_file honors it and
deletes a record as usual but does not return error code if
a record does not exist already. Function zebra_extract_file takes
action parameter rather then deleteFlag. The file/path update
is changed accordingly. zebraidx honors command 'adelete'.
Adam Dickmeiss [Thu, 20 Dec 2007 11:03:53 +0000 (11:03 +0000)]
Bump version to 2.0.21.
Adam Dickmeiss [Wed, 19 Dec 2007 14:11:36 +0000 (14:11 +0000)]
Funcion zebra_recid_to_sysno only attemps mapping if segment
indexing is enabled.
Adam Dickmeiss [Wed, 19 Dec 2007 13:46:04 +0000 (13:46 +0000)]
Require YAZ 3.0.17.
Adam Dickmeiss [Wed, 19 Dec 2007 13:38:21 +0000 (13:38 +0000)]
Towards 2.0.20.
Adam Dickmeiss [Wed, 19 Dec 2007 13:35:39 +0000 (13:35 +0000)]
On facets and versions.
Adam Dickmeiss [Wed, 19 Dec 2007 09:30:29 +0000 (09:30 +0000)]
Added some material about ICU chains.
Adam Dickmeiss [Tue, 18 Dec 2007 13:55:28 +0000 (13:55 +0000)]
WS updates (no code changes).
Adam Dickmeiss [Tue, 18 Dec 2007 13:41:27 +0000 (13:41 +0000)]
Prevent zebra_clean from deleting files for uncommited trans.
Adam Dickmeiss [Tue, 18 Dec 2007 13:39:39 +0000 (13:39 +0000)]
Simplify definition
Adam Dickmeiss [Tue, 18 Dec 2007 10:04:15 +0000 (10:04 +0000)]
Allow 'index' setting value 'none' for no index types.
Using index:none in zebra.cfg is treated specially and is now allowed
to be used to specify 'no index types specified'.
Heikki Levanto [Mon, 17 Dec 2007 14:22:05 +0000 (14:22 +0000)]
Added a note on unlimited disk space
Heikki Levanto [Mon, 17 Dec 2007 14:12:09 +0000 (14:12 +0000)]
Improved error reporting in case of no more space. Now it lists each directory
with info on how much used and available.
Anders S. Mortensen [Mon, 17 Dec 2007 12:38:57 +0000 (12:38 +0000)]
Added a little documentation.
Anders S. Mortensen [Mon, 17 Dec 2007 12:28:50 +0000 (12:28 +0000)]
Finished.
Adam Dickmeiss [Mon, 17 Dec 2007 12:24:50 +0000 (12:24 +0000)]
Escape backslash for ICU terms in searches
Adam Dickmeiss [Mon, 17 Dec 2007 12:23:03 +0000 (12:23 +0000)]
Scan test. Using ICU config in 'tab'.
Adam Dickmeiss [Mon, 17 Dec 2007 12:22:05 +0000 (12:22 +0000)]
Added word ICU config for da (Danish).
Anders S. Mortensen [Mon, 17 Dec 2007 11:48:14 +0000 (11:48 +0000)]
Added.
Adam Dickmeiss [Mon, 17 Dec 2007 08:44:07 +0000 (08:44 +0000)]
Sort indexes using ICU normalization.
Adam Dickmeiss [Thu, 13 Dec 2007 20:19:40 +0000 (20:19 +0000)]
Added clean-local sections to fix make distcheck
Adam Dickmeiss [Thu, 13 Dec 2007 19:59:21 +0000 (19:59 +0000)]
Removed log msg
Adam Dickmeiss [Thu, 13 Dec 2007 19:50:26 +0000 (19:50 +0000)]
Consider srcdir in tests (for make distcheck)
Adam Dickmeiss [Thu, 13 Dec 2007 19:50:13 +0000 (19:50 +0000)]
Add modulePath (fix distcheck)
Adam Dickmeiss [Thu, 13 Dec 2007 18:10:49 +0000 (18:10 +0000)]
MARCXML example uses ICU.
Adam Dickmeiss [Thu, 13 Dec 2007 18:10:35 +0000 (18:10 +0000)]
ICU charmap files.
Adam Dickmeiss [Thu, 13 Dec 2007 18:08:26 +0000 (18:08 +0000)]
Fix icuchain file load to use profilePath
Adam Dickmeiss [Thu, 13 Dec 2007 17:42:28 +0000 (17:42 +0000)]
MARCXML example is using filter 'dom' instead of 'alvis'.
Adam Dickmeiss [Thu, 13 Dec 2007 17:41:50 +0000 (17:41 +0000)]
Proper identity XSL
Adam Dickmeiss [Thu, 13 Dec 2007 15:43:52 +0000 (15:43 +0000)]
ICU test is UTF-8 based.
Adam Dickmeiss [Thu, 13 Dec 2007 11:09:20 +0000 (11:09 +0000)]
ICU functional for scan and snippets.
Adam Dickmeiss [Mon, 10 Dec 2007 17:06:07 +0000 (17:06 +0000)]
Handle display buf for searches (ICU).
Extend zebra_map_tokenize_next to return display terms. For
RPN-query evaluation (rpnsearch.c) store display term in WRBUF
rather than buffer.
Adam Dickmeiss [Fri, 7 Dec 2007 14:17:37 +0000 (14:17 +0000)]
Added test for complete-subfield search (:p).
Adam Dickmeiss [Fri, 7 Dec 2007 14:09:09 +0000 (14:09 +0000)]
ICU term lists are handled for search.
Adam Dickmeiss [Wed, 5 Dec 2007 09:55:10 +0000 (09:55 +0000)]
Allow facet size to be specified.
A facet size may be specified by appending colon and number
after index type, e.g. zebra::facet::title:w:10 .
Adam Dickmeiss [Wed, 5 Dec 2007 09:29:52 +0000 (09:29 +0000)]
Sort facets by set frequency.
Adam Dickmeiss [Tue, 4 Dec 2007 12:52:33 +0000 (12:52 +0000)]
SUTRS-like result for Facet.
Adam Dickmeiss [Tue, 4 Dec 2007 11:13:17 +0000 (11:13 +0000)]
Remove log message from zebra_recid_to_sysno
Adam Dickmeiss [Mon, 3 Dec 2007 17:16:48 +0000 (17:16 +0000)]
Added strmap object
Adam Dickmeiss [Mon, 3 Dec 2007 17:09:01 +0000 (17:09 +0000)]
Reduce number of CHECKs so that speed can be tested
Adam Dickmeiss [Mon, 3 Dec 2007 16:54:49 +0000 (16:54 +0000)]
Removed unused source symtab.c.
Adam Dickmeiss [Mon, 3 Dec 2007 14:33:35 +0000 (14:33 +0000)]
Added more tests WRT position attribute
Adam Dickmeiss [Mon, 3 Dec 2007 14:33:22 +0000 (14:33 +0000)]
Memory leak fix - in case of error in use of position attribute.
Adam Dickmeiss [Mon, 3 Dec 2007 13:34:17 +0000 (13:34 +0000)]
Omit first-in-field index terms for facets
Adam Dickmeiss [Mon, 3 Dec 2007 13:04:04 +0000 (13:04 +0000)]
Added function zebra_create_rset_isam .
Adam Dickmeiss [Mon, 3 Dec 2007 12:57:55 +0000 (12:57 +0000)]
Added position attribute test
Adam Dickmeiss [Mon, 3 Dec 2007 11:49:11 +0000 (11:49 +0000)]
First functional facet result (zebra::facet::..).
Adam Dickmeiss [Mon, 3 Dec 2007 11:47:53 +0000 (11:47 +0000)]
Log records when they differ in tl_fetch_compare
Adam Dickmeiss [Mon, 3 Dec 2007 11:46:39 +0000 (11:46 +0000)]
Fixed memory leak for safari filter
Adam Dickmeiss [Mon, 3 Dec 2007 09:12:38 +0000 (09:12 +0000)]
Added zebra_strmap_it(erator).
Adam Dickmeiss [Sun, 2 Dec 2007 11:30:28 +0000 (11:30 +0000)]
Added simple string map (hash) utility.
Adam Dickmeiss [Sat, 1 Dec 2007 21:34:10 +0000 (21:34 +0000)]
Fixed bug in zebra_recid_to_sysno (handle non isamb case)
Adam Dickmeiss [Fri, 30 Nov 2007 12:19:08 +0000 (12:19 +0000)]
Allow record retrieval for record types using custom record IDs.
A filter may specify its own record_id by assigning a non-zero
to record_id member in RecWord. However, until this commit, the
original record was not retrievable . Updating only occured with
a custom match ID. With this patch the record can be retrieved .
The allrecords index (_ALLRECORDS) is used as a map between custom
record IDs and Zebras internal record store which is identified by the
system-number (storeData and storeKeys).
Adam Dickmeiss [Fri, 30 Nov 2007 10:08:01 +0000 (10:08 +0000)]
Added testlib functions for fetch of records
Adam Dickmeiss [Fri, 30 Nov 2007 09:51:31 +0000 (09:51 +0000)]
Moved local declaration (for debugging)
Adam Dickmeiss [Wed, 28 Nov 2007 11:16:32 +0000 (11:16 +0000)]
Extend recindex system may use ISAMB for records map.
The recindex system may use ISAMB for map between record ID
and record data. The recindex_open has an extra parameter to
enable this feature (disabled for now).
Adam Dickmeiss [Wed, 28 Nov 2007 10:38:10 +0000 (10:38 +0000)]
WS updates (no code changes).
Adam Dickmeiss [Wed, 28 Nov 2007 09:56:42 +0000 (09:56 +0000)]
Extend isamb_merge read handler with new insert mode.
Extend isamb_merge read handler, read_item, with new insert mode of
value 2. Like 1 this means "insertion", but, unlike 1, forces an existing
key to be replaced even though the comparison is 0. Until now ISAMB
has assumed "same" key for value of 0.
Adam Dickmeiss [Fri, 23 Nov 2007 14:00:16 +0000 (14:00 +0000)]
New records.obj; removed recstat.obj
Adam Dickmeiss [Fri, 23 Nov 2007 13:59:14 +0000 (13:59 +0000)]
Got rid of redundant files WRT records mgt.
Adam Dickmeiss [Fri, 23 Nov 2007 13:52:52 +0000 (13:52 +0000)]
Factor records system mgt into recindex.c, records.c.
Adam Dickmeiss [Fri, 23 Nov 2007 13:11:08 +0000 (13:11 +0000)]
Refactor recindex out of Records struct
Adam Dickmeiss [Thu, 15 Nov 2007 08:53:24 +0000 (08:53 +0000)]
Version 2.0.19. Use YAZ' wrbuf_write_escaped.
Adam Dickmeiss [Thu, 15 Nov 2007 08:53:04 +0000 (08:53 +0000)]
More ICU tests
Adam Dickmeiss [Wed, 14 Nov 2007 21:10:46 +0000 (21:10 +0000)]
Ignore logfiles
Adam Dickmeiss [Wed, 14 Nov 2007 21:10:26 +0000 (21:10 +0000)]
Ingnore test programs and log files.
Adam Dickmeiss [Wed, 14 Nov 2007 13:12:41 +0000 (13:12 +0000)]
Added small test
Adam Dickmeiss [Wed, 14 Nov 2007 09:51:00 +0000 (09:51 +0000)]
Make a test somewhat more readable
Adam Dickmeiss [Wed, 14 Nov 2007 09:44:16 +0000 (09:44 +0000)]
Use test facility of YAZ
Adam Dickmeiss [Tue, 13 Nov 2007 13:41:51 +0000 (13:41 +0000)]
Use zebra_map_get_or_add instead of zebra_map_get for searches.
Use zebra_map_get_or_add instead of zebra_map_get for searches.
For systems that do not define default.idx the system must generate
a zebra map for it (and warn if default.idx was used).
Adam Dickmeiss [Mon, 12 Nov 2007 13:41:19 +0000 (13:41 +0000)]
Require YAZ 3.0.16 or later
Adam Dickmeiss [Mon, 12 Nov 2007 13:40:50 +0000 (13:40 +0000)]
Update for ICU transform (was normalize)
Adam Dickmeiss [Thu, 8 Nov 2007 21:21:58 +0000 (21:21 +0000)]
First successful test with ICU sortkeys in dictionary.
Adam Dickmeiss [Thu, 8 Nov 2007 21:21:16 +0000 (21:21 +0000)]
Added test of regexp patterns (DFA)
Adam Dickmeiss [Thu, 8 Nov 2007 13:35:36 +0000 (13:35 +0000)]
Update for locale API changes.
Adam Dickmeiss [Thu, 8 Nov 2007 09:30:05 +0000 (09:30 +0000)]
Use header icu.h instead of icu_I18N.h
Adam Dickmeiss [Thu, 8 Nov 2007 08:18:37 +0000 (08:18 +0000)]
Check for YAZ_HAVE_ICU instead of HAVE_ICU
Adam Dickmeiss [Thu, 8 Nov 2007 07:54:17 +0000 (07:54 +0000)]
Do not perform t17 if ICU is disabled
Adam Dickmeiss [Wed, 7 Nov 2007 11:22:58 +0000 (11:22 +0000)]
Fix non-ICU compilation (due to previous commit)
Adam Dickmeiss [Wed, 7 Nov 2007 10:24:28 +0000 (10:24 +0000)]
Added first test ICU indexing test
Adam Dickmeiss [Tue, 6 Nov 2007 10:29:58 +0000 (10:29 +0000)]
The zebramaps implements index_types functionality.
Adam Dickmeiss [Mon, 5 Nov 2007 13:58:01 +0000 (13:58 +0000)]
Merge icu_chain into zebramaps.
Adam Dickmeiss [Mon, 5 Nov 2007 11:36:23 +0000 (11:36 +0000)]
Changed error handling for unknown zebra maps.
The zebramaps system a warning the first time an inknown index type
is used. This warning, should only be issued if maps were read from
a configfile (zebra_maps_read_file).
Adam Dickmeiss [Mon, 5 Nov 2007 11:27:24 +0000 (11:27 +0000)]
Refactor zebramaps parsing
Adam Dickmeiss [Mon, 5 Nov 2007 11:20:39 +0000 (11:20 +0000)]
Changed limit set parameter for rpn_scan
Adam Dickmeiss [Thu, 1 Nov 2007 16:01:33 +0000 (16:01 +0000)]
Beginnings of facets
Adam Dickmeiss [Thu, 1 Nov 2007 15:59:47 +0000 (15:59 +0000)]
WS changes for function calls.
Adam Dickmeiss [Thu, 1 Nov 2007 14:56:07 +0000 (14:56 +0000)]
Added rpn_facet which does little at this stage.
Adam Dickmeiss [Thu, 1 Nov 2007 14:12:44 +0000 (14:12 +0000)]
Document scan approximative limit
Adam Dickmeiss [Thu, 1 Nov 2007 14:10:03 +0000 (14:10 +0000)]
Honor approximative limits for scan (type 12).
The documentation mentions attribute 9/11. However, that's not
found anywhere in the code. Attribute 12 is chosen (same as a
search global approximative limit).
Adam Dickmeiss [Wed, 31 Oct 2007 16:56:13 +0000 (16:56 +0000)]
Changed the index type to a string everywhere.
The functions zebra_map_get and zebra_map_get_or_add changed their
3rd argument 'int reg_id' to 'const char *id'. The recExtractCtrl struct
defined in idzebra/recctrl.h changed: the seqno array was removed. It
is used by no filters and assumes that index type(AKA register type)
is a char (int).
Adam Dickmeiss [Tue, 30 Oct 2007 19:17:15 +0000 (19:17 +0000)]
Introduced zebra_map_t in zebra_maps API.
Adam Dickmeiss [Mon, 29 Oct 2007 22:22:06 +0000 (22:22 +0000)]
WS changes for function calls.
Adam Dickmeiss [Mon, 29 Oct 2007 20:07:04 +0000 (20:07 +0000)]
Refactor database lookup to single function.
Search for each database is handled by rpn_search_APT_database.
Resultes for each database is collected by rpn_search_APT. This
is simpler and shorter than previous version of search which had
database merge in multiple places.
Adam Dickmeiss [Mon, 29 Oct 2007 19:54:46 +0000 (19:54 +0000)]
Revert
Adam Dickmeiss [Mon, 29 Oct 2007 16:57:51 +0000 (16:57 +0000)]
Changed type of index_type char/int to string.
The index_type is part of the RecWord structure which is used by all
record filters. It used to be a int char (e.g. 'w'). It is now a string
so that arbitrary index types can be specified . For example there might
be a Greek Title (e.g. word:greek or word_greek).
Adam Dickmeiss [Mon, 29 Oct 2007 13:43:57 +0000 (13:43 +0000)]
First indexing using index_types system (ICU).
Adam Dickmeiss [Mon, 29 Oct 2007 11:10:43 +0000 (11:10 +0000)]
WS changes for function calls.