Adam Dickmeiss [Mon, 14 Jan 2008 20:45:24 +0000 (20:45 +0000)]
Summarize news (from ChangeLog).
Adam Dickmeiss [Mon, 14 Jan 2008 20:37:08 +0000 (20:37 +0000)]
Remove yaz-ziffy Debian package.
Adam Dickmeiss [Mon, 14 Jan 2008 20:34:14 +0000 (20:34 +0000)]
Factor ziffy out as a separate package.
Adam Dickmeiss [Fri, 11 Jan 2008 17:04:02 +0000 (17:04 +0000)]
More news
Adam Dickmeiss [Wed, 9 Jan 2008 21:35:23 +0000 (21:35 +0000)]
Changed license of CCL module to 'Revised BSD'
Adam Dickmeiss [Wed, 9 Jan 2008 21:32:27 +0000 (21:32 +0000)]
Changed license of CCL module to 'Revised BSD'.
Adam Dickmeiss [Wed, 9 Jan 2008 15:34:30 +0000 (15:34 +0000)]
Build yaz-icu if ICU is enabled on Windows.
Adam Dickmeiss [Wed, 9 Jan 2008 15:33:31 +0000 (15:33 +0000)]
DLL export ICU functions.
Adam Dickmeiss [Wed, 9 Jan 2008 15:00:47 +0000 (15:00 +0000)]
ICU support on Windows version of YAZ.
Prepare makefile for ICU support. Thanks to Tumer Garip.
Adam Dickmeiss [Mon, 7 Jan 2008 17:32:49 +0000 (17:32 +0000)]
Fixed bug in ZOOM_options_getl WRT setting of parameter lenp.
Fixed bug in ZOOM_options_getl WRT setting of parameter lenp that
would be unset if a callback_handle is used to retrieve the options
value. This bug caused ZOOM extended services update to malfunction.
Adam Dickmeiss [Sun, 6 Jan 2008 21:48:23 +0000 (21:48 +0000)]
Added tests using cql2pqf.
Adam Dickmeiss [Sun, 6 Jan 2008 19:34:34 +0000 (19:34 +0000)]
CQL free-form terms are ANDed (extra terms).
CQL free-form terms are ANDed in the CQL to PQF conversion. For
example, dc.title = a b, means dc.title = a and dc.title = b.
And the query (a "b c") means (a and "b c"). This might be configurable
in a future version of the conversion. This does not alter semantics for
non-free form term queries, e.g. dc.title=a .
Adam Dickmeiss [Sun, 6 Jan 2008 17:37:13 +0000 (17:37 +0000)]
Added CQL free-form term tests.
Adam Dickmeiss [Sun, 6 Jan 2008 16:22:02 +0000 (16:22 +0000)]
Added support for free-form-terms. Bug #609: HDCQL.
Adam Dickmeiss [Sun, 6 Jan 2008 13:08:09 +0000 (13:08 +0000)]
CQL v1.2 functionality except sort.
Modify CQL parser and transform code to become more CQL 1.2 compliant.
Default relation is '=' instead 'scr'. Relation for exact is ==
instead of 'exact'. Work on bug #609: HDCQL.
Adam Dickmeiss [Sun, 6 Jan 2008 13:02:48 +0000 (13:02 +0000)]
Use shell /usr/bin/tclsh for Tcl scripts.
Use shell /usr/bin/tclsh for Tcl scripts. Do not use the smart exec
invokation trick. It causes more confusion . Systems such as
Debian has /usr/bin/tclsh as the preferred Tcl shell anyway.
Adam Dickmeiss [Thu, 3 Jan 2008 23:10:08 +0000 (23:10 +0000)]
Always _BSD_SOURCE .
Always _BSD_SOURCE regardless of GLIBC or not. Testing for __GLIBC__
after include of stdio.h was apparantly not enough
Adam Dickmeiss [Thu, 3 Jan 2008 23:04:07 +0000 (23:04 +0000)]
Internal Debian pkg
Adam Dickmeiss [Thu, 3 Jan 2008 22:55:17 +0000 (22:55 +0000)]
libyaz3-dev depends on some tclsh
Adam Dickmeiss [Thu, 3 Jan 2008 22:54:06 +0000 (22:54 +0000)]
Define _BSD_SOURCE whenever GLIBC is used.
For ziffy, define _BSD_SOURCE whenever GLIBC is used. This is
to fix compilation on GNU/kFreeBSD. Debian bug #410346.
Adam Dickmeiss [Sun, 30 Dec 2007 22:04:12 +0000 (22:04 +0000)]
configure prefers tclsh over other versions.
The configure now prefers tclsh over other versions because tclsh is
(usually) the preferred tcl shell as set by the administrator.
Adam Dickmeiss [Thu, 27 Dec 2007 13:27:40 +0000 (13:27 +0000)]
Do not reset querytype if session resets (HTTP/SRU).
Adam Dickmeiss [Fri, 21 Dec 2007 19:01:33 +0000 (19:01 +0000)]
Improved tokenization for yaz-client coammnds update and xmles.
The yaz-client commands update and xmles takes documents as parameters
and parse_cmd_doc is used. This now accepts one of the forms:
<filename, "quoted string", straightstring .
Adam Dickmeiss [Fri, 21 Dec 2007 08:31:42 +0000 (08:31 +0000)]
Ensure fname is 0-terminated in parse_cmd_doc for yaz-client.
Adam Dickmeiss [Thu, 20 Dec 2007 22:45:37 +0000 (22:45 +0000)]
Fixed bug #1988: CQL-to-PQF translation mishandles quoted doube.
Fixed bug #1988: CQL-to-PQF translation mishandles quoted doube quotes.
The CQL already uses \-escaped strings (such as \") . These can be
copied verbatim to PQF.
Adam Dickmeiss [Wed, 19 Dec 2007 12:36:42 +0000 (12:36 +0000)]
Added YAZ_FILEVERSION
Adam Dickmeiss [Wed, 19 Dec 2007 11:02:20 +0000 (11:02 +0000)]
Towards 3.0.18.
Adam Dickmeiss [Tue, 18 Dec 2007 21:13:06 +0000 (21:13 +0000)]
Do not use Libxml2's reader if libxml2 version < 2.6.15.
Adam Dickmeiss [Tue, 18 Dec 2007 14:07:08 +0000 (14:07 +0000)]
Using YAZ' options rather than getopt.h.
Ziffy now uses YAZ' options rather than getopt.h because getopt.h
is unavailable on some systems.
Adam Dickmeiss [Tue, 18 Dec 2007 12:46:02 +0000 (12:46 +0000)]
Annotate
Adam Dickmeiss [Mon, 17 Dec 2007 20:59:30 +0000 (20:59 +0000)]
Support read/write MARCXML collections.
Adam Dickmeiss [Mon, 17 Dec 2007 11:23:16 +0000 (11:23 +0000)]
Fixed bug in icu_buf_utf8_to_cstr (wrong length).
Fixed bug in icu_buf_utf8_to_cstr . A string could be truncated because
its string length is set to 0 in icu_buf_utf8_resize. Function
icu_buf_utf8_resize no longer resets the string.
Adam Dickmeiss [Sun, 16 Dec 2007 22:43:59 +0000 (22:43 +0000)]
About new OPAC stuff
Adam Dickmeiss [Sun, 16 Dec 2007 11:08:50 +0000 (11:08 +0000)]
Handle OPAC for record conversion module.
Extend the record_conv system to handle Z39.50 OPAC records.
Function yaz_record_conv_opac_record was added.
Adam Dickmeiss [Tue, 11 Dec 2007 13:35:45 +0000 (13:35 +0000)]
Added ZOOM_package_option_{set,get}l.
Added ZOOM_package_option_{set,get}l so that binary data can be used
for Z39.50 packages (Update, etc). Using option_getl rather then
option_get for few options that might be binary: "doc", "record" and
"recordIdOpaque".
Adam Dickmeiss [Tue, 11 Dec 2007 13:14:45 +0000 (13:14 +0000)]
Ensure ICU is part of built
Adam Dickmeiss [Mon, 10 Dec 2007 22:10:09 +0000 (22:10 +0000)]
No action-not-found rule for ICU.
Adam Dickmeiss [Mon, 10 Dec 2007 20:33:47 +0000 (20:33 +0000)]
Generate yaz3.dll version from yaz-version.h
Adam Dickmeiss [Fri, 7 Dec 2007 10:01:53 +0000 (10:01 +0000)]
Suggest yaz-doc instead of Recommend for libyaz3-dev
Adam Dickmeiss [Fri, 30 Nov 2007 11:44:46 +0000 (11:44 +0000)]
Adjustments to make YAZ compile as C++ code.
Adam Dickmeiss [Fri, 30 Nov 2007 11:43:47 +0000 (11:43 +0000)]
Changed return value of function icu_sortkey8_from_utf16 to void.
The return value is useless and error is signalled by status
parameter. This breaks binary compatibility for that function but
it is not in use anywhere.
Adam Dickmeiss [Fri, 30 Nov 2007 11:42:04 +0000 (11:42 +0000)]
Use oid_class rather than int for OID class.
Changed oclass parameter for yaz_oid_add function from type int to
enum oid_class. This should not break binary compatibility.
Changed oid member in struct yaz_oid_entry to enum oid_class.
Adam Dickmeiss [Wed, 21 Nov 2007 13:53:20 +0000 (13:53 +0000)]
Use schema in Z39.50 Update.
If schema is given, supply it as part of Z39.50 Extended Service
update. Patch from Jacob Poulsen.
Adam Dickmeiss [Wed, 21 Nov 2007 09:04:46 +0000 (09:04 +0000)]
Man pages in Reference section.
All man pages are combined in one Reference section, manref.xml,
which is extracted via XSLT from each individual man page.
Adam Dickmeiss [Fri, 16 Nov 2007 08:01:47 +0000 (08:01 +0000)]
Update test for new wrbuf_puts_escaped functions
Adam Dickmeiss [Thu, 15 Nov 2007 08:45:52 +0000 (08:45 +0000)]
Introduce wrbuf_{write,puts}_escaped.
Introduce wrbuf_{write,puts}_escaped. Removed wrbuf_verbose_str
which now has the new name wrbuf_write_escaped. wrbuf_verbose_str
has not been used outside YAZ in released software so this should
be safe. Added a few Doxygen comments for wrbuf.h as well.
Adam Dickmeiss [Thu, 15 Nov 2007 08:36:31 +0000 (08:36 +0000)]
Added yaz_puts_escaped
Adam Dickmeiss [Thu, 15 Nov 2007 08:33:15 +0000 (08:33 +0000)]
Version 3.0.17.
Adam Dickmeiss [Thu, 15 Nov 2007 08:28:08 +0000 (08:28 +0000)]
ICU utility prints sortkey as well
Adam Dickmeiss [Wed, 14 Nov 2007 21:03:59 +0000 (21:03 +0000)]
Doxygen comments
Adam Dickmeiss [Mon, 12 Nov 2007 11:48:13 +0000 (11:48 +0000)]
More on the ICU wrapper.
Adam Dickmeiss [Mon, 12 Nov 2007 11:43:47 +0000 (11:43 +0000)]
Fix spelling
Adam Dickmeiss [Mon, 12 Nov 2007 11:41:53 +0000 (11:41 +0000)]
yaz-icu man page/program in yaz-icu package only.
The yaz-icu man page and program is part of package yaz-icu (not
yaz). Descriptions in debian/control fixed to keep linda happy.
Adam Dickmeiss [Mon, 12 Nov 2007 11:14:48 +0000 (11:14 +0000)]
yaz-icu part of packages
Adam Dickmeiss [Mon, 12 Nov 2007 11:13:05 +0000 (11:13 +0000)]
Added yaz-icu man page
Adam Dickmeiss [Mon, 12 Nov 2007 11:12:19 +0000 (11:12 +0000)]
Update to use transform step
Adam Dickmeiss [Mon, 12 Nov 2007 11:11:16 +0000 (11:11 +0000)]
Renamed 'normalize' rule to 'transform'.
The ICU chain step, normalize is now called transform because
that's what ICU calls it. And we better keep things aligned.
Adam Dickmeiss [Mon, 12 Nov 2007 08:58:16 +0000 (08:58 +0000)]
Towards 3.0.16
Adam Dickmeiss [Mon, 12 Nov 2007 08:57:45 +0000 (08:57 +0000)]
Using iochan_event_loop (WIN32)
Adam Dickmeiss [Mon, 12 Nov 2007 08:47:22 +0000 (08:47 +0000)]
Program yaz-icu is noinst rather than bin.
Program yaz-icu is noinst rather than bin for now. Will be installed in
bin when a man page has been created, bug #1797.
Adam Dickmeiss [Mon, 12 Nov 2007 08:43:49 +0000 (08:43 +0000)]
Added note about yaz_poll
Adam Dickmeiss [Mon, 12 Nov 2007 08:41:56 +0000 (08:41 +0000)]
Rename function event_loop to iochan_event_loop.
Adam Dickmeiss [Sat, 10 Nov 2007 08:59:31 +0000 (08:59 +0000)]
Do not handle EINTR in yaz_poll.
Change yaz_poll so that it does not loop around select/poll if
errno=EINTR is set. This sitution is handled in caller, such
as event_loop used by GFS which must take further action if EINTR
is set. If EINTR is handled by yaz_poll it does not get caught.
Adam Dickmeiss [Fri, 9 Nov 2007 22:08:14 +0000 (22:08 +0000)]
Change timeout parameter for yaz_poll.
Change timeout paramater from seconds to seconds+nano-seconds for
yaz_poll. Also make yaz_poll_{poll,select} static (internal).
Adam Dickmeiss [Fri, 9 Nov 2007 21:52:38 +0000 (21:52 +0000)]
Remove include of sys/select.h from tcpip.c . It is not needed.
Adam Dickmeiss [Fri, 9 Nov 2007 19:00:42 +0000 (19:00 +0000)]
Use yaz_poll everywhere.. And fix syntax error!
Adam Dickmeiss [Fri, 9 Nov 2007 19:00:08 +0000 (19:00 +0000)]
Describe new functions.
Adam Dickmeiss [Fri, 9 Nov 2007 18:49:19 +0000 (18:49 +0000)]
Enable use of yaz_poll always in event_loop.
Adam Dickmeiss [Fri, 9 Nov 2007 18:47:50 +0000 (18:47 +0000)]
YAZ GFS uses yaz_poll.
The event_loop function uses by YAZ' Generic Frontend Server uses
the yaz_poll function - instead of select.
Adam Dickmeiss [Fri, 9 Nov 2007 16:46:43 +0000 (16:46 +0000)]
Implemented yaz_poll - select/poll wrapper.
Adam Dickmeiss [Thu, 8 Nov 2007 18:02:04 +0000 (18:02 +0000)]
Reindent
Adam Dickmeiss [Thu, 8 Nov 2007 17:22:48 +0000 (17:22 +0000)]
Allow any locale for icu_chain_create.
Adam Dickmeiss [Thu, 8 Nov 2007 17:20:32 +0000 (17:20 +0000)]
Use xmalloc instead of malloc.
Adam Dickmeiss [Thu, 8 Nov 2007 17:20:11 +0000 (17:20 +0000)]
Ignore test program
Adam Dickmeiss [Thu, 8 Nov 2007 17:15:13 +0000 (17:15 +0000)]
Avoid locale member in icu_tokenizer.
The locale member of icu_tokenizer is not needed.
Adam Dickmeiss [Thu, 8 Nov 2007 17:08:10 +0000 (17:08 +0000)]
Function icu_casemap_create no longer takes locale parameter.
Function icu_casemap_create no longer takes locale parameter. Instead,
icu_casemap_casemap takes a locale parameter.
Adam Dickmeiss [Thu, 8 Nov 2007 13:35:13 +0000 (13:35 +0000)]
Refactor ICU WRT locale.
The locale parameter is no longer a parameter for icu_chain_xml_config
and locale is read as an attribute for top XML node. The icu_casemap
locale is no longer a member and a parater for icu_casemap_casemap
instead. This saves a copy of a locale in each casemap.
Adam Dickmeiss [Thu, 8 Nov 2007 09:29:38 +0000 (09:29 +0000)]
Public header icu.h, private header icu_I18N.h .
Adam Dickmeiss [Thu, 8 Nov 2007 09:07:14 +0000 (09:07 +0000)]
Indent
Adam Dickmeiss [Thu, 8 Nov 2007 09:03:11 +0000 (09:03 +0000)]
Changed header - part of YAZ not Pazpar2
Adam Dickmeiss [Thu, 8 Nov 2007 08:17:17 +0000 (08:17 +0000)]
For ICU enabled YAZ defined YAZ_HAVE_ICU instead of HAVE_ICU.
Adam Dickmeiss [Wed, 7 Nov 2007 10:19:12 +0000 (10:19 +0000)]
For ICU, set ICU status to OK for some public functions.
The ICU status code, UErrorCode, is now set to U_ZERO_ERROR in
the preamble of functions icu_chain_create, icu_chain_xml_config
and icu_chain_next_token.
Adam Dickmeiss [Wed, 7 Nov 2007 09:50:24 +0000 (09:50 +0000)]
ICU element index and sortkey no longer available.
Adam Dickmeiss [Tue, 6 Nov 2007 10:27:30 +0000 (10:27 +0000)]
For ICU, locale, is a char ptr rather than uint8_t ptr.
The type uint8_t is a ICU type that we don't want to use if we
can avoid it.
Adam Dickmeiss [Thu, 1 Nov 2007 10:32:43 +0000 (10:32 +0000)]
Fixed printf of pointer
Adam Dickmeiss [Thu, 1 Nov 2007 10:29:28 +0000 (10:29 +0000)]
Fixed link to OID tools
Adam Dickmeiss [Wed, 31 Oct 2007 21:58:07 +0000 (21:58 +0000)]
Fixed bug #1122: Certain record IDs are not found by searches.
The CQL parser preserves terms completely and \\s are no longer
removed. This changes CQL output for some test cases and so these
are updated accordingly. The CQL to PQF transform only treats
* and ? operators if they aren't escaped. A memory leak was also
fixed for the ANSIZ39.58 pattern case.
Marc Cromme [Mon, 29 Oct 2007 13:50:57 +0000 (13:50 +0000)]
changed ICU chain to return all tokens, also those which became empty under normalization. These might still have some display terms attached to them, which are to be used by the snippet display stuff or the scan term display stuff.
Marc Cromme [Mon, 29 Oct 2007 10:22:22 +0000 (10:22 +0000)]
renamed ICU chain functions to the following names relation the operation
to the actually processed token
int icu_chain_token_number(struct icu_chain * chain);
const char * icu_chain_token_display(struct icu_chain * chain);
const char * icu_chain_token_norm(struct icu_chain * chain);
const char * icu_chain_token_sortkey(struct icu_chain * chain);
Adam Dickmeiss [Mon, 29 Oct 2007 09:16:32 +0000 (09:16 +0000)]
Extended auth command so that NULL User, pass may be set.
This is to solve bug #1820.
Marc Cromme [Thu, 25 Oct 2007 10:04:32 +0000 (10:04 +0000)]
added special case with an empty ICU chain for 'raw' index processing without call of transliterators, case maps or tokenizators. It's optimized such that the following happens:
if (!chain->sort), no utf8 to utf16 translation occurs, and the original cstring is returned for the icu_chain-get_norm8() call.
if (chain->sort), utf8 to utf16 translation is made, the original cstring is returned for the icu_chain-get_norm8() call, and the utf16->sortkey conversion is run previous of calling icu_chain-get_sort8().
Marc Cromme [Thu, 25 Oct 2007 08:42:21 +0000 (08:42 +0000)]
simplified test case XML config root element tags
Marc Cromme [Thu, 25 Oct 2007 08:40:06 +0000 (08:40 +0000)]
removed dead code from ICU files
Marc Cromme [Thu, 25 Oct 2007 08:32:50 +0000 (08:32 +0000)]
added sortkey flag to icu_chain constructor
Adam Dickmeiss [Wed, 24 Oct 2007 22:10:24 +0000 (22:10 +0000)]
Avoid per-target CPPFLAGS.
If we use per-target flags, AM_PROG_CC_C_O is required or we just
dont it.
Marc Cromme [Wed, 24 Oct 2007 14:48:17 +0000 (14:48 +0000)]
Isolated ICU locale out of XML config file. Locale is now the second argument to chain = icu_chain_xml_config(xml_node, (uint8_t *) "en", &status);
Adam Dickmeiss [Wed, 24 Oct 2007 13:50:02 +0000 (13:50 +0000)]
Added yaz_match_glob
Marc Cromme [Wed, 24 Oct 2007 13:23:34 +0000 (13:23 +0000)]
fixed wrong token count when tokens disappear with ICU normalization
Marc Cromme [Wed, 24 Oct 2007 07:41:48 +0000 (07:41 +0000)]
fixed memory violation in ICU chain code, restructuring tokenizer to allow for non-empty tokens still ongoing work
Marc Cromme [Tue, 23 Oct 2007 07:51:57 +0000 (07:51 +0000)]
surpressed ICU test tokenization output