Marc Cromme [Mon, 12 Jun 2006 11:48:24 +0000 (11:48 +0000)]
extended discusson of how ranking works
Marc Cromme [Mon, 12 Jun 2006 09:39:17 +0000 (09:39 +0000)]
removed non-functional ZVrank algorithm for ever. Removed description in documentation.
Marc Cromme [Mon, 12 Jun 2006 09:27:00 +0000 (09:27 +0000)]
added makefile entry fro examples/marcxml
Marc Cromme [Mon, 12 Jun 2006 09:12:13 +0000 (09:12 +0000)]
added alvis filter marcxml config in dist tarball
Marc Cromme [Fri, 9 Jun 2006 20:46:38 +0000 (20:46 +0000)]
reduced example XML size, tweaked indexing rules, added display XSLT sheet for zebra internal info
Marc Cromme [Fri, 9 Jun 2006 20:07:04 +0000 (20:07 +0000)]
more rules
Marc Cromme [Fri, 9 Jun 2006 13:20:56 +0000 (13:20 +0000)]
added description of example
Marc Cromme [Fri, 9 Jun 2006 12:53:18 +0000 (12:53 +0000)]
indexing example MARCXML working now
Marc Cromme [Fri, 9 Jun 2006 12:22:16 +0000 (12:22 +0000)]
added few indexing rules
Marc Cromme [Thu, 8 Jun 2006 10:53:28 +0000 (10:53 +0000)]
aded record indexing rule - now need to do all seperate indexes
Adam Dickmeiss [Thu, 8 Jun 2006 10:33:19 +0000 (10:33 +0000)]
Function data1_path_fopen doesn not call yaz_fopen if profilePath
is NULL or "".
Marc Cromme [Thu, 8 Jun 2006 10:04:33 +0000 (10:04 +0000)]
removed
Marc Cromme [Thu, 8 Jun 2006 09:35:33 +0000 (09:35 +0000)]
added MADS stylesheet
Marc Cromme [Thu, 8 Jun 2006 09:31:28 +0000 (09:31 +0000)]
added comments on LOC data
Marc Cromme [Thu, 8 Jun 2006 09:30:57 +0000 (09:30 +0000)]
corrected path to xslt stylesheets
Marc Cromme [Thu, 8 Jun 2006 09:22:58 +0000 (09:22 +0000)]
alvis marcxml filter records and example config started
Adam Dickmeiss [Thu, 8 Jun 2006 08:30:37 +0000 (08:30 +0000)]
Require YAZ 2.1.20 or later
Marc Cromme [Thu, 8 Jun 2006 08:28:22 +0000 (08:28 +0000)]
added 43 example marc21 xml records from LOC
Adam Dickmeiss [Wed, 7 Jun 2006 20:50:23 +0000 (20:50 +0000)]
Remove grs.csv, grs.danbib, xslt filters from configure
Adam Dickmeiss [Wed, 7 Jun 2006 18:26:02 +0000 (18:26 +0000)]
Include manifest for msvcr80.dll.
Adam Dickmeiss [Wed, 7 Jun 2006 14:37:37 +0000 (14:37 +0000)]
Bundle .manifest files. Use /r for doc stuff (due to doc/common)
Adam Dickmeiss [Wed, 7 Jun 2006 14:37:02 +0000 (14:37 +0000)]
Copy .dll.manifest from YAZ to bin
Marc Cromme [Wed, 7 Jun 2006 13:17:48 +0000 (13:17 +0000)]
correcting typo's
Marc Cromme [Wed, 7 Jun 2006 13:10:19 +0000 (13:10 +0000)]
honing text on classic explain with fully worked yaz-client examples
Adam Dickmeiss [Wed, 7 Jun 2006 11:20:03 +0000 (11:20 +0000)]
Bundle with Visual Studio 8 CRT by default
Adam Dickmeiss [Wed, 7 Jun 2006 11:02:06 +0000 (11:02 +0000)]
Ignore my.LCK which is generated by test tstflock.c
Adam Dickmeiss [Wed, 7 Jun 2006 11:00:46 +0000 (11:00 +0000)]
Fix log of zint type
Adam Dickmeiss [Wed, 7 Jun 2006 10:50:08 +0000 (10:50 +0000)]
Changed some types from int to zint + added a few casts
Adam Dickmeiss [Wed, 7 Jun 2006 10:14:39 +0000 (10:14 +0000)]
Use CAST_ZINT_TO_INT in some places, so we can easily spot casts
Adam Dickmeiss [Wed, 7 Jun 2006 10:01:11 +0000 (10:01 +0000)]
For VS, define _CRT_NONSTDC_NO_DEPRECATE
Adam Dickmeiss [Wed, 7 Jun 2006 07:50:58 +0000 (07:50 +0000)]
Make ChangeLog as part of make dist
Adam Dickmeiss [Tue, 6 Jun 2006 21:01:30 +0000 (21:01 +0000)]
Removed rsbool_create_and, rsbool_create_or because they are no in use.
Renamed rs<type>_create functions to rset_create_<type>.
Adam Dickmeiss [Tue, 6 Jun 2006 09:46:52 +0000 (09:46 +0000)]
Removed xslt+danbibr from win makefile
Adam Dickmeiss [Tue, 6 Jun 2006 08:55:22 +0000 (08:55 +0000)]
Added some information about "classic" Explain.
Marc Cromme [Fri, 2 Jun 2006 13:55:55 +0000 (13:55 +0000)]
removed grs.danbib filter
removed grs.csv filter
removed xslt filter
all unused and dead code
Adam Dickmeiss [Fri, 2 Jun 2006 10:59:53 +0000 (10:59 +0000)]
Revert
Adam Dickmeiss [Fri, 2 Jun 2006 10:59:21 +0000 (10:59 +0000)]
Dont generate xsl.in files
Adam Dickmeiss [Thu, 1 Jun 2006 13:10:16 +0000 (13:10 +0000)]
Reformat
Adam Dickmeiss [Thu, 1 Jun 2006 13:05:52 +0000 (13:05 +0000)]
Fixed bug in r_open (isam:s)
Marc Cromme [Wed, 31 May 2006 16:11:58 +0000 (16:11 +0000)]
removing the XSLT filter from the build, only keeping the ALVIS filter
Adam Dickmeiss [Tue, 30 May 2006 23:08:29 +0000 (23:08 +0000)]
Let configure generate doc/local.ent rather than doc/zebra.xml .
Update doc/Makefile.am to use _COMPILE definitions.
Adam Dickmeiss [Tue, 30 May 2006 22:03:13 +0000 (22:03 +0000)]
Update sort test to use the missingValueAction = 'abort'.
Adam Dickmeiss [Tue, 30 May 2006 21:41:35 +0000 (21:41 +0000)]
Fixed bug #597: Support null missing key for sort. Reject type
missingValueData which is unsupported.
Adam Dickmeiss [Tue, 30 May 2006 13:44:44 +0000 (13:44 +0000)]
encode_info moved from index.h to extract.c and simplified
Adam Dickmeiss [Tue, 30 May 2006 13:21:13 +0000 (13:21 +0000)]
Change return type for a zebra_add_record + zebra_repository functions to
be ZEBRA_RES rather than int. Split code in index/trav.c into two.
Adam Dickmeiss [Tue, 30 May 2006 13:06:35 +0000 (13:06 +0000)]
Show iteration number if t15 fails
Mike Taylor [Tue, 30 May 2006 09:56:47 +0000 (09:56 +0000)]
Ignore generated htmlhelp.hhp, toc.hhc
Marc Cromme [Mon, 29 May 2006 13:48:43 +0000 (13:48 +0000)]
made place for record delete
Mike Taylor [Mon, 29 May 2006 08:28:19 +0000 (08:28 +0000)]
Ignore tstflock
Adam Dickmeiss [Wed, 24 May 2006 19:12:46 +0000 (19:12 +0000)]
Documentation for now based on Docbook XML/XSLT using xsltproc + Norman
Walsh's stylesheets. It means that the CVS version of Zebra is no longer
depending on jade/openjade or docbook-to-man scripts. PDF is no longer
part of the distribution - but can optionally be made using DSSSL/jadetex
or FOP.
Adam Dickmeiss [Wed, 24 May 2006 19:10:18 +0000 (19:10 +0000)]
Depend on Tcl 8.4 instead of Tcl 8.3
Adam Dickmeiss [Wed, 24 May 2006 18:31:33 +0000 (18:31 +0000)]
Fixed bug #594: Zebra pollutes XSLT output? For alvis and xslt
filter we are using xsltSaveResultToString instead of xmlDocDumpMemory.
Marc Cromme [Wed, 24 May 2006 12:56:56 +0000 (12:56 +0000)]
corrected logical error in finding indexation stylesheet
Marc Cromme [Wed, 24 May 2006 08:23:01 +0000 (08:23 +0000)]
returning default schema name or identifier when no element set is specified
Marc Cromme [Tue, 23 May 2006 15:21:58 +0000 (15:21 +0000)]
added support for default retrieval schema other than indexing schema
Marc Cromme [Tue, 23 May 2006 10:04:43 +0000 (10:04 +0000)]
updated with YAZ info
Marc Cromme [Tue, 23 May 2006 09:41:06 +0000 (09:41 +0000)]
added items to configuration display and instructions
Adam Dickmeiss [Mon, 22 May 2006 13:28:00 +0000 (13:28 +0000)]
Fixed bug #454: Indexing with grs.regx much slower than version 1.3.32.
The hash function in the record key management system was improved and
the hash size was increased. This make this sub system approx 10
times faster as far as gprof is concerned. There _is_ a bigger overhead
with the 64-bit keys over Zebra's 32-bit keys, but not much.
Adam Dickmeiss [Mon, 22 May 2006 11:43:32 +0000 (11:43 +0000)]
Ignore register and shadow
Adam Dickmeiss [Fri, 19 May 2006 23:45:28 +0000 (23:45 +0000)]
Remove local attribute handling and other dead code.
Adam Dickmeiss [Fri, 19 May 2006 23:20:24 +0000 (23:20 +0000)]
Furhter code reductions because of string attributes
Adam Dickmeiss [Fri, 19 May 2006 17:33:18 +0000 (17:33 +0000)]
Use new YAZ logging calls (YAZ_USE_NEW_LOG)
Adam Dickmeiss [Fri, 19 May 2006 17:28:55 +0000 (17:28 +0000)]
added zvrank again
Adam Dickmeiss [Fri, 19 May 2006 17:28:11 +0000 (17:28 +0000)]
added ranksimilarity, removed zvrank
Adam Dickmeiss [Fri, 19 May 2006 13:49:33 +0000 (13:49 +0000)]
Zebra uses string attributes for indexing internally. Using set+numeric
use attribute can still be used. But that is a search-only conversion which
inspects .att-set files as indicated using attset-directives in zebra.cfg.
attset references are no longer required, but when used they deserve
as "check" for that the index names used are also present in .att.
Adam Dickmeiss [Thu, 18 May 2006 12:03:05 +0000 (12:03 +0000)]
Sort Keys are stored using the reckeys_t structure. sort files
are named with the ordinal value (index ID) , rahter than use-attribute.
This patch ease the move towards string indexes everywhere.
Adam Dickmeiss [Wed, 17 May 2006 17:46:44 +0000 (17:46 +0000)]
Implemented bug #588: allrecords search. Using @attr 1=allrecords ""
matches all records in a database.
Mike Taylor [Wed, 17 May 2006 14:12:56 +0000 (14:12 +0000)]
Fix mistake: fuzzy matching is 5=103, not 5=102
Add truncation.regexp, 5=102
Marc Cromme [Thu, 11 May 2006 10:26:13 +0000 (10:26 +0000)]
changed API to get terms and docs in fields
Adam Dickmeiss [Thu, 11 May 2006 10:15:33 +0000 (10:15 +0000)]
Make two functions to get term/doc occurrences rather than one.
Adam Dickmeiss [Wed, 10 May 2006 14:13:45 +0000 (14:13 +0000)]
Check size of off_t and adjust printf format accordingly.
Adam Dickmeiss [Wed, 10 May 2006 13:54:01 +0000 (13:54 +0000)]
Fix printing of match string in updating code
Adam Dickmeiss [Wed, 10 May 2006 13:46:55 +0000 (13:46 +0000)]
Fix bad init of zebSUInfoB node
Adam Dickmeiss [Wed, 10 May 2006 12:31:08 +0000 (12:31 +0000)]
Added code which maintains number of term occurrences and document
occurrences for an index.
Adam Dickmeiss [Wed, 10 May 2006 12:30:02 +0000 (12:30 +0000)]
Fixed rec_cp. Did not copy the 0-termiante info buffers
Adam Dickmeiss [Wed, 10 May 2006 09:11:22 +0000 (09:11 +0000)]
No more experiments with combined sh libs
Adam Dickmeiss [Wed, 10 May 2006 09:08:55 +0000 (09:08 +0000)]
Optimize zebraExplain_lookup_attr_{su, str} by using a impementing
a move-to-front stategy.
Adam Dickmeiss [Wed, 10 May 2006 08:13:17 +0000 (08:13 +0000)]
Put local variables footer in all c, h files.
Marc Cromme [Wed, 10 May 2006 07:54:41 +0000 (07:54 +0000)]
changed comments
Marc Cromme [Tue, 9 May 2006 11:31:37 +0000 (11:31 +0000)]
added sysno and matchStr (if exists) to logging of add/update/delete indexing operations on files
Adam Dickmeiss [Tue, 9 May 2006 10:46:56 +0000 (10:46 +0000)]
Fixed bug #576: Regexp-2 search misses hits. Problem was that
init_pos was always set to 2. And the ordinal encoded prefix might
be of length 1. Hence the first character would not be part of regular
expression _with_ errors.
Adam Dickmeiss [Tue, 9 May 2006 08:12:22 +0000 (08:12 +0000)]
Remove unneeded debug logs
Marc Cromme [Mon, 8 May 2006 14:03:16 +0000 (14:03 +0000)]
added spots for missing statistics: size_docs_field no_docs_field no_docs_database size_docs_database no_terms_field
Marc Cromme [Mon, 8 May 2006 12:09:49 +0000 (12:09 +0000)]
added doxygen rules
make dox
make showdox
Marc Cromme [Mon, 8 May 2006 10:09:07 +0000 (10:09 +0000)]
added hit count in ressultset
corrected yaz logging which complained over wrong types on ADM 64
Adam Dickmeiss [Fri, 5 May 2006 17:19:38 +0000 (17:19 +0000)]
For buildconf.sh -d, add -Wdeclaration-after-statement
Adam Dickmeiss [Fri, 5 May 2006 17:18:50 +0000 (17:18 +0000)]
Avoid declaration after statement
Adam Dickmeiss [Fri, 5 May 2006 13:17:34 +0000 (13:17 +0000)]
Log when a file is opened using data1 system
Adam Dickmeiss [Fri, 5 May 2006 09:15:11 +0000 (09:15 +0000)]
Added two YAZ_EXPORTS
Adam Dickmeiss [Fri, 5 May 2006 09:14:02 +0000 (09:14 +0000)]
Implement functions to get register usage statistics:
mf_area_directory_stat, bfs_{register,shadow}_directory_stat.
Adam Dickmeiss [Fri, 5 May 2006 09:12:21 +0000 (09:12 +0000)]
Added prototype recTypeClass_load_modules
Adam Dickmeiss [Fri, 5 May 2006 07:34:25 +0000 (07:34 +0000)]
By default, no searching for loadable modules is performed unless
modulePath is defined.
Marc Cromme [Thu, 4 May 2006 10:11:09 +0000 (10:11 +0000)]
added more statistics to rank function, renamed variables to better names
Marc Cromme [Wed, 3 May 2006 13:55:20 +0000 (13:55 +0000)]
added statistics to similarity rank function
Marc Cromme [Wed, 3 May 2006 13:26:12 +0000 (13:26 +0000)]
added coment on magic number 34 which is sqrroot of 1000
Marc Cromme [Wed, 3 May 2006 09:42:39 +0000 (09:42 +0000)]
removed emacs trailer
Marc Cromme [Wed, 3 May 2006 09:31:25 +0000 (09:31 +0000)]
added new ranking function rank-similar in ranksimilar.c
moved ranking related declarations from header index.h to header rank.h
Mike Taylor [Tue, 2 May 2006 12:55:18 +0000 (12:55 +0000)]
Completed revision of text.
Mike Taylor [Tue, 2 May 2006 12:23:02 +0000 (12:23 +0000)]
Rolling mods to Marc's new ranking prose. (Check in early, check in
often, to reduce conflicts if Adam is also working on this. Actually,
if he is, and if my checking happens first, then there will still be
conflicts but I will have shifted them onto Adam, as whoever checks in
second has to resolve the problems. So I should have said that this
checkin is in order to shift/reduce conflicts :-)
Marc Cromme [Tue, 2 May 2006 08:27:43 +0000 (08:27 +0000)]
added possibility to display static rank information in output of xslt and alvis filter. Added member staticrank to recRetrieveCtrl.