3 yaz-ztest returns schema for MARCXML test records. SRU require that
4 recordSchema for records.
6 GFS: make surrogate diagnostic when yaz_record_conv_record fails -
7 instead of non-surrogate diagnostic. This is a per-record failure.
9 GFS: Allow multiple listenrefs YAZ-554. A server in yazgfs configuration
10 may refer to multiple listeners now. Attribute listenref is a comma separated
13 GFS: Use xmlconfig path as prefix for fnames YAZ-702. When -f
14 option is given for GFS, the dirname of filename (for -f) is used
15 as prefix for options such as cql2rpn, ccl2rpn, etc.
17 Content-Type charset fixes YAZ-701 . Do not inspect charset in
18 Content-Type header for SOAP when decoding SRU. The payload (XML)
19 itself tells what encoding it is. In response, never supply encoding
20 in Content-Type. The response payload (XML) tells what it is (with no
21 encoding in XML it's UTF-8).
23 HTTP decoding: allow blanks in URL paths YAZ-700
27 Various fixes for how SRU 2.0 is encoded. Fix NS for SRU 2.0 diagnostics
28 and facets. Ensure recordData and recordSchema are always present in
29 record element, because they are required.
31 Remove deprecated functions yaz_uri_val .. and yaz_uri_val_int. Never used
34 Simplify in a lot of places using odr_strdupn.
36 odr_create_Odr_oct: null terminate the buffer. Some applications rely on it.
40 Increase various buffers in GFS's statserv_options_block
41 Change many 'unsigned char *' to 'char *' for ODR-related utilties.
42 This change makes many type-casts redundant, and, thus simplifies code.
44 Remove last bits of WAIS support.
46 Remove member 'size' from Odr_oct.
48 Slim down the public part of 'struct odr'. Most elements are not part
49 of struct Odr_private.
51 Add support for SRU 2.0. Since SRU 2.0 is incompatible with earlier
52 versions of SRU, yaz-client and zoom C are using SRU 1.2 by default.
53 In particular facets are supported in both client - and server side.
54 Facets are also supported for Z39.50 and is carried in additionalSearchInfo
55 of searchRequest/searchResponse with OID 1.2.840.10003.10.1000.81.5 AKA
56 "Facet-1" in oid.csv. The info is defined in facet.asn (which covers
57 both request/response). This is what a search handler in the GFS
58 will see (regardless of whether operating in SRU mode or Z39.50).
60 Changes to the srw.h (SRU/Solr) definitions include:
61 - New element in Z_SRW_searchRetrieveRequest, queryType (char*) and query
62 (char*), which replace union query and query_type (int). This is because
63 SRU 2.0 supports a queryType parameter. This also means that, to carry
64 PQF, in SRU we can now use queryType=pqf and query=PQFstring , rather than
65 x-pquery=PQFstring (extention parameter). The extension parameter
67 - New element, packing, that has information about SRU
68 2.0 recordPacking (not to be confused with SRU 2.0 recordXMLEscaping).
70 New element in Z_SRW_searchRetrieveResponse, resultCountPrecision.
72 New element, packing, in Z_SRW_explainRequest.
74 New elements in Z_SRW_scanRequest, queryType and scanClause.
75 These replace query_type and scanClase untion. This is similar to what
80 GFS: log when closing down - at least SIGTERM YAZ-684
81 Also change formatting WRT PID logging a bit.
83 Improve display of MARC records with multi-byte subfield IDs YAZ-695
84 In some rare cases subfield identifiers are multi-byte characters.
85 This will try to deterime length of those and split accordingly.
86 This affects display in line mode as MARCXML/MarcXchange. The encoding
87 of ISO2709 is the same.
89 Change inp argument to const for yaz_read_UTF8_char.
91 yaz-marcdump: fix leaks for MARCXML parsing. YAZ-694
93 MARCXML parsing: avoid skipping 1st field if no leader. YAZ-693
95 Better check of marc leader info YAZ-691
96 Problem is that some systems generate MARCXML/MarcXchange with
97 funny headers. These will not work if encoded as ISO2709.
98 Some tests produce new output, due to updated warning messages
100 cql2pqf: allow PQF queries from stdin (because CQL is also allowed)
102 yaz-client: display MAB records YAZ-689.
103 Thanks for Heiko Jansen for this patch.
105 New utility z_get_HTTP_Response_server which allows both HTTP server name
106 and HTTP server URL to be given in response.
108 Debian: do not depend on obs tcl8.3.
110 Debian: do not depend on obs libicu36-dev.
112 --- 4.2.68 2013/09/23
114 GFS: pass additionalSearchInfo to search memeber search_input if
115 given. Otherwise pass otherInfo. Request for facets and other search
116 related things will be passed there in future versions of YAZ.
118 New ZOOM setting, authenticationMode, which allows authentication
119 paramters to be encoded in the URL rather than via HTTP Basic auth.
122 rpn2solr: fix nested AND/OR handling. YAZ-685
124 Add comparison routines for some Z-types, such as NamePlusRecord,
125 RPNQuery, Query, RecordComposition and OtherInformation.
127 --- 4.2.67 2013/09/19
129 Don't decode MAB as MARC. Just like we don't attempt to decode
130 HTML/XML as MARC. Fixes MAB display problem that was introduced in 4.2.64.
132 CCL: allow quoted terms for date ranges. YAZ-681
134 Introduce ccl_parser_qual_search. This function makes old function
135 ccl_qual_search, from YAZ 2, available again.
137 Add yaz_facet_list_to_wrbuf. YAZ-683
139 --- 4.2.66 2013/09/11
141 ZOOM: fix record handling for Solr. ZOOM_record_get would return 0, if
142 schema was given for search. YAZ-675
144 Add Solr date range searches. YAZ-621
146 --- 4.2.65 2013/08/22
148 ZOOM: another fix for record caching (introduced in YAZ 4.2.64).
150 --- 4.2.64 2013/08/21 (Broken WRT ZOOM C, do not use)
152 ISO2709/MARC parse most octet aligned records; not just those that
153 are known to be ISO2709/MARC. This makes ZOOM and yaz-client
154 MARC parse more records instead of just dumping as is. YAZ-670
156 ZOOM: proper caching for variations of record schema. YAZ-671
158 Solr: Check for enging / and perhaps commands (select/term) YAZ-651
160 --- 4.2.63 2013/07/17
164 --- 4.2.62 2013/07/11
166 New utility z_get_HTTP_Response_details - an extended version of
169 New utility yaz_url_get_error which returns error message of last
170 failed yaz_url_exec call.
172 yaz-url and url functions: allow max HTTP redirects to be controlled.
174 New functions yaz_file_glob2, yaz_xml_include_glob.
175 These functions takes a flags parameter, which, for now only controls
176 whether to fail inclusion of a non-existing file (without glob
177 pattern) - flags YAZ_FILE_GLOB_FAIL_NOTEXIST.
179 --- 4.2.61 2013/06/20
181 For MARC XML parsing, allow record without leader. A fake/default leader
182 is inserted and a warning is tagged with the record.
184 ICU: fix leak in in icu_iter_get_org_info.
186 --- 4.2.60 2013/06/14
188 ICU: fix bug in icu_iter_get_org_info (un-init variable).
190 --- 4.2.59 2013/06/11
192 Implement z_HTTP_header_remove.
194 --- 4.2.58 2013/06/11
196 ICU: Disallow 0 ptrs for some ICU string utilities.
198 ICU: new utilities icu_iter_get_org_info and icu_chain_get_org_info:
199 returns original tokens (before normalization).
201 CCL: avoid z39.58/regex truncation when not needed. Apply only the
202 conversion of those masks, when absolutely necessary.
204 CCL: configurable masking character - @mask. Default masking character
207 HTTP encoding: remove Transfer-Encoding header. YAZ uses content_len and
208 full response anyway, so a Transfer-Encoding header will obstruct the
211 --- 4.2.57 2013/05/15
213 COMSTACK: @ uses AF_UNSPEC . But we prefer AF_INET6 over others when
214 picking a socket. Problem is that some systems has IPV6 support, but
215 we can't create sockets for them, so we pick AF_UNSPEC first.
217 HTTP encode. Proper Content-Length YAZ-660. For yaz_encode_http_response
218 use content_len to determine resulting Content-Length in HTTP response
219 and NOT Content-Length supplied in headers by user.
221 z_HTTP_header_add_basic_auth uses z_HTTP_header_set rather than
222 z_HTTP_header_add, to avoid having two Authorization headers by mistake.
224 Fix problem with HTTP decoding. For HTTP 1XX, 204, 304 assume no
227 Fix yaz_base64decode to use proper signed. Problem occurred on platforms
228 with big endian and unsigned char (by default).
230 --- 4.2.56 2013/04/26
232 Fix yaz-client connect (crash in 4.2.55).
234 --- 4.2.55 2013/04/26
236 Fix proxy/host problem for ZOOM that could occur if unix sockets
239 New Debian package libyaz4-dbg.
241 Fix problem with cs_close hang/wait in SSL mode. Invoke gnutls_bye
242 differently in tcpip_close.
244 --- 4.2.54 2013/04/17
246 Windows installer of YAZ includes YAZ4J as a component.
248 CQL: allow "extra terms" again, by default. Thus, the CQL parser
249 accepts a superset the standard. This reverts to CQL as of YAZ 4.2.51
250 and earlier. CQL parser may operate in strict mode where queries
251 not conforming to the standard BNF are rejected (syntax error).
252 Whether the CQL parser operates in strict mode is controlled with
253 cql_parser_strict . Strict mode enabled with option -S for utilities
254 cql2pqf and cql2xcql .
256 yaz-ztest: returns OPACXML records for syntax=XML and element set=OP.
258 --- 4.2.53 2013/04/10
260 New charset, MARC-8c, which is like MARC-8 but allows control characters
261 0x01 through 0x1F, except ESC to be passed through verbatim.
263 Fix a problem with duplicate sub field character in MARC output. Problem
264 happened only when output was MARC-8 encoded.
266 --- 4.2.52 2013/04/03
268 yaz-ztest: Use hash for fake hit count. Before, random number was used.
269 This is problematic for unit tests using yaz-ztest. This patch also makes
270 a hash for CQL queries. For RPN, any term with a leading digit will be
271 treated as pseudu hit count (to force any particular hit count by a client).
273 yaz-ztest: return unique MARC dummy records. Beyond record offset
274 24, the author surname is patched with offset to make all records
277 COMSTACK: make @ bind to IPV6+IPV4 consistenly and avoid depending
278 on system wide default (/proc/sys/net/ipv6/bindv6only).
279 @4 binds to IPV4 only. @6 binds to IPV6 only.
281 Update CQL API documentation a bit
283 CQL: don't accept extra terms for queries. Makes the CQL parser
284 stricly conformant to the standard.
286 --- 4.2.51 2013/02/12
288 GFS: scan handler gets extra_args from request and may return extra
289 response data . That's for SRU only.
291 Solr scan support for ZOOM and yaz-client. Patch from Simon Jacob.
293 --- 4.2.50 2013/01/30
295 New function, yaz_xml_to_opac, to convert from OPACXML to Z39.50 OPAC.
297 OPACXML: sync spelling of availabilityDate in XML to that of Schema
298 opaxxml.xsd. The schema had the correct spelling of this member always.
299 The ASN.1 was mis-spelled and still is (API change) - we are
300 not changing this. However, the OPAC to XML conversion had yet
303 GFS: Allow conversion between Z39.50 OPAC and OPACXML via retrieval
306 New function, z_ext_record_oid_nmem, which is similar to
307 z_ext_record_oid but takes NMEM rather than ODR
309 --- 4.2.49 2013/01/18
311 ICU: New conversion element 'join' which joins tokens into one
312 with a custom character given by rule attribute.
314 --- 4.2.48 2013/01/10
316 New GFS search member: present_number. This is a hint to the
317 search handler how many records are going to be fetched immediately
318 following search. There's no guarantee that it's going to be the case,
319 since it depends on hit count (for Z39.50 piggyback) and whether errors
322 Make a few functions static (private). The functions getbyte_stream,
323 ungetbyte_stream and yaz_gets are now private. They were never declared
326 yaz-marcdump: exit(5) for serious decoding errors
328 ISO2709 decoding: be more picky WRT header
330 GFS: bail out of fetch if last_in_set is set. Until now, last_in_set,
331 was only used as to indicate that next-result-set-position should be
333 http://www.loc.gov/z3950/agency/markup/04.html#Next-result-set-position
334 Based on patch from Ashley Sanders.
336 Make some functions static/private in PQF parsing. Those functions were
337 never declared in a public header and so should not be in use by
338 applications based on YAZ.
340 --- 4.2.47 2012/11/23
342 ZOOM: special options to control APDU logging.
343 Using ZOOM_connection_option_set(c, "saveAPDU", "1") will enable
344 logging of APDUs until "saveAPDU" option is set again. If logging is
345 already enabled the effect is that current APDU buffer is cleared.
346 Using ZOOM_connection_option_set(c, "saveAPDU", "0") disables
347 logging (default behavior on new connection).
348 The APDUs sent/received can be obtained by using
349 Using ZOOM_connection_option_get(c, "APDU") or
350 ZOOM_connection_option_getl(c, "APDU", &l).
352 GFS: relay implementation_version from backend
353 From 3.0.40 and later, implementation_version from backend was
354 not used in init response at all.
356 --- 4.2.46 2012/11/15
358 Fix cs_rcvconnect for SSL comstack GNUTLS. Did not work in non-blocking
359 mode at all. Probably never did.
361 Make a new version of ztest.pem that, at least, is not expired.
363 --- 4.2.45 2012/11/13
365 Fix description of CCL directive 'case'.
367 More tight checking of form arguments (yaz_uri_to_array). Makes
368 YAZ better at rejecting big and/or bad POSTs.
370 SRU decoding does not report more than up to 10 invalid arguments.
372 rpn2cql: less quotes in generated terms. Semantics unchanged, but
373 it's prettier this way.
375 --- 4.2.44 2012/10/25
377 New utility yaz_decode_init_diag. Defined in proto.h.
379 Allow HTTP protocol on unix local socket. Also Z39.50 database may be
380 given for unix local socket.
381 The COMSTACK string for doing so is:
384 unix:/myfile:tcp:localhost:9999/mybase
385 unix:/myfile:localhost:9999/mybase
386 unix:/myfile:http://fakehost/mybase
388 debian: Use dpkg-buildflags in build process.
390 --- 4.2.43 2012/10/19
392 ZOOM C: don't trust recordPosition always. Some servers, such as IGI
393 global's SRU service uses a recordPosition scheme starting from zero.
394 First record's position should be one
395 according to the standard.
397 --- 4.2.42 2012/10/18
399 Allow more namespaces for SRU. This is to allow, for example, an
400 incorrect namespace returned from server
401 http://services.igi-global.com/sru .
403 Minor fixes for compilation on Windows.
405 --- 4.2.41 2012/10/11
407 daemon: log total number of bad signals from child on stop so that it
408 is more easy to spot problems with child worker processes.
410 retrieval: empty backend name attribute omits element set
411 from being used in retrieval.
413 --- 4.2.40 2012/10/04
415 Implement Solr sort strategy "solr", similar to sru11 sorting.
416 This will implement the correct parameters on Solr requst to do
419 --- 4.2.39 2012/09/28
421 Implement ccl_qual_fitem2. Like ccl_qual_fitem but with diagnostic
424 MARC: Extra/missing indicator handled for MARCXML.
425 The indicator length is given in header and is the same for the
426 whole record. If attributes ind1, ind2 are missing, then content
427 character defaults to blank. Extra indicator attributes (beyond)
428 indicator length are treated as an error.
430 Reformat: delete trailing whitespace
432 --- 4.2.38 2012/09/17
434 MARC: fix non-ASCII characters for leader. This is to ensure we can
435 generate XML in UTF-8.
437 CCL: new special attribute s=ag . Almost s=pw,al but preserves words
438 in one node with structure word.
440 --- 4.2.37 2012/09/04
442 yaz-json-parse: JSON output may be pretty printed by using option
445 Increase default value of max message for Z39.50 Init for GFS, ZOOM
446 and yaz-client. Old value was 1 MB. New value is 64 MB.
448 --- 4.2.36 2012/08/22
450 yaz-client: don't display bogus records from SRU servers. Some SRU servers
451 return more records than given by *maximumRecords*. Skipping those in
454 record_render: simplify buffer return handling and fix at least one bad
455 memory reference, that broke the test_embed_record sometimes.
457 Allow http://user:pass@host notation for yaz_url_exec.
459 zoomsh: allow shell command to be executed. Via the system(3) call.
461 yaz_poll: Allow num_fds == 0
463 yaz-client: fix bad encoding of "itemorder item". The itemorder
464 item <no> - command forgot to use length of encoded Item Request
465 package. Error present since YAZ 3.
467 yaz-ztest: fix bad usage of session handle. Bug was introduced when
468 result sets were saved (271a9c83).
470 SRU recordPacking: guess record packing in response rather than looking
471 at the recordPacking element which, OF COURSE, changed semantics in SRU
474 Decode SRU 2.0 responses. The official namespace for responses, according
475 to http://docs.oasis-open.org/search-ws/searchRetrieve/v1.0/cs01/schemas/sruRes
476 appears to be http://docs.oasis-open.org/ns/search-ws/sruResponse .
477 nature.com's server, however, usee namespace
478 http://docs.oasis-open.org/ns/search-ws/sru-2-0-response . For this reason
479 we are now using a glob-expr to match up the namespace. ZOOM C and
480 yaz-client updated. Perhaps SRU 1.2 uses same namespace, I don't know.
481 I can not find a single real example showing the "real" namespace in
482 the documentation from OASIS. The namespace for requests is different
483 from responses, but this is not added to YAZ yet, when we don't encode
486 --- 4.2.35 2012/06/26
488 zoom/record_render: add support for Base64 decoding fo MARC records
489 within XML element. For example: "xml; charset=marc-8; base64=/my/text()"
490 which will decode base64 + ISO2709 marc-8 encoded material from text node
493 --- 4.2.34 2012/06/07
495 Add missing definitions ZOOM_resultset_get_facet_field_by_index
496 and ZOOM_resultset_facets_names.
498 zoom: fix bad free for ZOOM_connect - happened when ZOOM connection
501 Change APDU dump printing to avoid long leading blanks. For levels 16
502 or larger the level is shown and the indentation is truncated but
503 recursed with modula 8. This makes it still reasonable easy to read
504 - even for nested BER dumps.
506 Fix bug completeBER_n WRT too nested BER. Function completeBER_n could
507 return 0 (incomplete package) in case where the BER package was
508 considered too nested (return value of -2).
510 dumpber: lines of level 15 are not indented further. Two spaces per
511 indentation; indentation 15 or more is indented to a fixed indentation
512 and augmented with a level=<no> indication.
514 zoomsh: increase max size of command+args
516 GFS: No limit in RPN buf size in CQL to RPN conversion.
518 --- 4.2.33 2012/05/09
520 New function for daemon utility, yaz_daemon_stop .
522 Makes yaz_srw_sortkeys_to_sort_spec public on Windows.
524 --- 4.2.32 2012/04/25
526 Add some Bib-1/SRU diagnostics + mappings. Bib-1: 1073 and
527 Bib-1 1074: Proxy failure. SRU: 1074: Proxy failure
529 --- 4.2.31 2012/04/23
531 YAZ daemon utility relays SIGUSR1 to child process.
533 ZOOM: handle trailing slash for Z39.50 urls. Previously localhost:9999/
534 would result in en empty database list - which in turn would result in
535 encoding failure for search.
537 Fix reading beyond string in yaz_sort_spec.
539 --- 4.2.30 2012/04/11
541 Add two new SRU diagnostics:
542 236: Access to specified database denied
543 1015: Init/AC: Maximum number of simultaneous sessions for Userid
545 Document the very useful ZOOM-C option "apdulog".
547 CQL to RPN: term may be passed through verbatim. This is enabled with
548 truncation.cql . The assumption being that the term is already CQL.
550 --- 4.2.29 2012/03/20
552 record_conv: leader spec may be given for marc element.
553 The leader spec is given as attribute leaderspec for element marc.
554 For example to convert a MARC21 record from MARC-8 to UTF-8:
555 <marc inputformat="marc" outputformat="marc"
556 inputcharset="marc-8" outputcharset="utf-8 "leaderspec="9='a'"/>
558 record_conv: allow user-XSLT params. For example:
559 <xslt stylesheet="MARC21slim2DC.xsl">
560 <param name="myparameter" value="myvalue"/>
561 <param name="otherparameter" value="othervalue"/>
564 record_conv: fix error handling for missing marc charsets.
566 CQL: fix extra terms in wrong order.
568 --- 4.2.28 2012/03/06
570 record_conv: modify new API for conversion types. The conversion types
571 may be passed in new functions yaz_record_conv_configure_t and
572 yaz_retrieval_configure_t. Removing yaz_record_conv_add_type .
574 Avoid mixed statement/variable declare; fixes compilation with Visual
577 --- 4.2.27 2012/02/28
579 Add non-standard SRU diagnostic: 235: "Database does not exist".
580 Couldn't live without it. HTTP 404: "Not found" is just so anonymous.
581 Update SRU to Bib-1 diagnostic maps accordingly.
583 CCL: add two new diagnostics for unsupported masking. The new
584 diagnostics are: "Embedded truncation not supported" and
585 "Single charcacter mask not supported".
587 --- 4.2.26 2012/02/23
589 CCL: fix use of "term" field in sub queries. Bug introduced in YAZ 4.2.25.
591 --- 4.2.25 2012/01/11
593 Build YAZ for Ubuntu Oneiric.
595 CCL: allow parantheses for proximity operands. For example CCL query
596 (a) % (b) is now allowed.
598 GFS: fix bend_assoc_is_alive. When cs_get returns 0 the association is
599 marked dead, rather then being destroyed. If not, the session memory is
600 being free'd before the search/scan handler is finished. Also destroy
601 'request' memory in request_release rather than in various places,
602 which resulted in leaks from time to time.
604 --- 4.2.24 2011/12/21
606 cql_sortby_to_sortkeys: honor sort prefix.
608 RPN to CQL: always quote resulting terms. For bizarre reasons, JSTOR's
609 SRU server returns 0 hits on ISSN searches unless a CQL term is quoted.
610 The rpn2cql family of functions now always returns quoted CQL terms.
612 Fix CQL to CCL conversion for multiple terms. Add two test cases as well.
614 --- 4.2.23 2011/12/15
616 Allow =val to be omitted for yaz_uri_to_array. Also, multiple &'s in
617 sequence is treated as one. For example, &&a=b&&&c& is identical to
620 --- 4.2.22 2011/12/05
622 Add ZOOM_connection_save_apdu_wrbuf. This function may be used to save
623 APDUs for a connection to a WRBUF.
625 --- 4.2.21 2011/11/23
627 Fix cql_sortby_to_sortkeys. Completely broken before.
629 Make CCL's @truncation work again.
631 --- 4.2.20 2011/11/09
633 New ZOOM connection setting: tproxy. It's like proxy, but does not
634 set Z39.50 proxy OID or change HTTP for proxy behavior. Can be used
635 to set resolved address + port for a connection outside ZOOM itself.
637 Fix atoi_n_check digit test. Thanks to Giannis Kosmas for spotting it.
639 --- 4.2.19 2011/11/07
641 Fix uninitialized variable in Solr spell support (could cause SEGV
642 for SRU response decoding).
644 Error handling for Z_APDU_close uses ZOOM_set_dset_error() to pass
645 back-end's addinfo through into the ZOOM response addinfo.
647 When ZOOM_set_dset_error() is passed an addinfo2 as well as addinfo,
648 they are separated by a colon and a space rather than simply
651 --- 4.2.18 2011/10/28
653 Add support for Solr spell-checking/suggestions through ZOOM.
654 If a Solr target has been configured correctly for spelling-checking
655 and suggestions, these will now be returned on the ResultSet option
656 "suggestions". zoomsh has been extended to show this with the cmd suggestions.
658 --- 4.2.17 2011/09/28
660 Fix function nmem_strsplit_escape2 which extends nmem_strsplit_escape
661 with a flag whether to substitute escape sequences or not.
663 --- 4.2.16 2011/09/22
665 Fix nmem_strsplit_escape to substitute escape char properly.
667 New option for zoomsh -e , which makes it abort on first error and
668 return process exit code to indicate success/failure.
670 YAZ options utility supports special option -- which makes all it treat
671 all following arguments as non-options.
673 --- 4.2.15 2011/09/16
675 Fix yaz_file_path_resolve/yaz_path_fopen/yaz_fopen so that path is not
676 searched if absolute filename is given.
678 Fix conv_xslt() error-reporting when stylesheet is not found.
679 (The value of fullpath is meaningless in this situation.)
681 --- 4.2.14 2011/09/07
683 Fix problem in CQL sort node creation: un-initialized memory.
685 New ZOOM utility ZOOM_query_sortby2. That takes a strategy parameter: one of
686 "z3950", "type7", "cql", "sru11" or "embed". The "embed" chooses type-7 or
687 CQL sortby depending on whether Type-1 or CQL is actually sent to the
690 New sortspec utilities: yaz_srw_sortkeys_to_sort_spec,
691 yaz_sort_spec_to_srw_sortkeys, yaz_sort_spec_to_type and 7yaz_sort_spec_to_cql.
693 rpn2solr supports Z39.58 truncation (104). Thus, CCL truncation mode t=z
694 will make it possible to use both single-character mask (#) and wildcard (?)
695 in CCL . Throw diagnostic for left truncation because that is not supported
698 --- 4.2.13 2011/09/01
700 Fixes for cql2rpn, cql2ccl and ccl2rpn; mostly in the area of special
701 cases using escapes (\-sequences) and masking.
703 PQF parse fix: A trailing backslash followed by end-of-string (\0)
704 would result in a read one byte beyond string.
706 rpn2ccl may use Z39.50 masking for terms (t=z).
708 ICU check fix. Don't include library -lCrun on Solaris, unless present.
710 ICU check fix: Use --cppflags-searchpath to determine ICU include files;
711 not --cppflags (which seeems like an error in icu-config).
713 --- 4.2.12 2011/08/27 RPM package only
715 cql2ccl: fix conversion of terms: operator characters were not
718 --- 4.2.11 2011/08/25 RPM package only
720 ccl2rpn: Conversion to regexp-1 terms (trunc=102). For mode t=x, the
721 CCL parser will map both # and ? to their regular expression
722 quivalents (. and .*).
724 rpn2cql: deal with truncation=102 (regexp-1). And ensure proper quoting
725 of reserved CQL characters.
727 cql2ccl: deal with both * and ? in conversion. Also leave escaped ones as
728 is, so that they are passed through.
730 --- 4.2.10 2011/08/24
732 ZOOM SRU mode: more aggressive re-connect.
734 Private function prox_unit_name() renamed to yaz_prox_unit_name() and
735 made available as a utility function, declared in <yaz/logrpn.h>
737 rpn2cql_structure() supports proximity nodes (except that the Type-1
738 proximity node's "exclusion" binary is ignored, as there is no way to
739 express that in CQL). Fixes bug #4564.
743 Fix SEGV that could occur if set command of zoomsh was given without
744 value (2nd argument).
746 Fix SEGV that could occur if unsupported transport was given for
747 COMSTACK - say https (when SSL was unavailable).
749 Build yaz-url on Windows too.
753 New utility to get web content. Header is url.h. A command line tool
754 yaz-url is part of the distribution and packages.
756 Fixes for SSL COMSTACK (when gnutls is in use).
758 New functions yaz_base64{encode,decode}. Header is base64.h.
762 ZOOM C includes HTTP response buffer as additional info if it fails
763 to decode the SRU response.
765 Make wrbuf_json_puts available.
769 zoom: throw diagnostic for invalid value for option "sru". Before a
770 bad SRU request was sent.
772 Adding new utility wrbuf_vp_puts.
774 Add cclxmlconfig.obj to win/makefile. It was missing completely.
778 ZOOM HTTP: use absoluteURI's in proxy mode as required by RFC 2616 (HTTP).
779 Fix a bug in handling of cookies. Fix a bug that would occur if proxy +
780 redirect was used at the same time.
782 MARC line mode decoding: be less picky about length given - first
783 5 digits of header that is.
785 CQL to CCL conversion: deal with CQL proximity (cql_to_ccl function).
787 Changes to decoding of SRU records: a record with recordPacking=xml is
788 modified with a new root element <yaz_record> if the recordData contains
789 multiple children elements. This is to make the record XML parseable
792 RPN to Solr conversion: encode special characters.
794 Generic Frontend Server: fix uinitialized member, stepSize.
798 Fix a bug in SRU decoding of records.. The database records stored
799 had un-initialized memory, but it would only be seen with yaz_record_render
800 and type_spec="ext" .
802 Fix a bug in ccl_qual_dup introduced in 4.2.3.
806 Add new CCL utility, ccl_qual_dup, which makes a copy of a CCL bibset.
810 Add new utilities to convert from CQL to CCL . These utilities have
811 prefix cql_to_ccl defined in cql.h.
813 Defensive coding for an off-by-one bug in ucol_getSortKey. This could
814 lead to memory heap corruptions when ICU utilities were in use.
818 Make compilation work without Libxml2.
820 yaz-client: remove redundant blanks in display of searchResult-1 term
825 CQL: parse CQL sortby spec. The resulting sort spec is stored in the
826 resulting CQL node (tree) in a new node CQL_NODE_SORT.
828 CQL and GFS: add utility cql_sortby_to_sortkeys which converts CQL sortby
829 1.2 node tree to CQL 1.1 spec. This in turn allows the generic frontend
830 server to only consider srw_sortkeys and support both SRU 1.1 and 1.2.
831 Note that the CQL sortby spec is only converted when the GFS is already
832 converting from CQL to RPN (cql2rpn element).
834 New function nmem_strsplitx. This is like nmem_strsplit but allows us to
835 specify whether to collapse delimitors or not. The existing nmem_strsplit
836 do collapse (collapse parameter = 1).
838 Windows installer: For NSIS, set InstallDir depending on x86/x64.
840 Rename internal func yaz_use_attribute_create. While non-static, this
841 function is not declared in a public header.
845 Add -lCrun when linking with ICU on Solaris.
847 More quicks character set conversions for OPAC records.
851 fix problem with record_render: records were converted (character set
852 wise) even if no charset was given. Problem introduced in YAZ 4.1.5.
856 SRU: add methods for handling DADS SRU-proxy facets.
858 Separate OPAC record character set for ZOOM_record. yaz_record_render
859 allows a character set given as charset=from/opacfrom,to where 'from' is
860 the character set of a bibliographic record, 'opacfrom' is character set
861 of OPAC record and 'to' is the target character set.
865 yaz-client: show may XML format records. Command show followed by 'format'
866 will format XML records retrieved using Libxml2's xmlDocDumpFormatMemory
869 src/stemmer.c: Avoid using unnamed union. It is not supported by some
872 For PHPYAZ: set YAZVERSION, not YAZ_VERSION.
875 Update yaz.spec to operate on both SLES11 / Centos 5.5.
877 RPM: Release includes 'indexdata' name. Use indexdata in release name so
878 this package can be distinguished from other vendors.
880 yaz-config: Use exec_prefix, libdir, includedir . Use these variables
881 as determined by configure
883 yaz-config: set YAZ_VERSION env. php_yaz relies on it.
885 GFS: Z_PresentStatus_partial_4 for missing record. If bend_fetch handler
886 returns no error and no record, the present request is considered
887 partial (only a subset of the records could be returned by backend), and
888 so it is appropriate to set Present Status to partial-4.
892 Move yaz-config man pages to section 1.
894 More documentation about Solr.
896 tcp comstack: change behavior for @-specs (anyaddr). @ listens on
897 AF_INET (IPV4) peers, and @6 listens to AF_INET6 (ipv6) peers.
898 Previously @ listened on AF_INET6 which accepted both IPV4 and IPV6
899 peers on some Linux systems. However, in general that does not work
900 so YAZ can not rely on that to work. Debian changed behavior in this
901 respect from Debian lenny to Debian squeeze (still testing as of Oct
903 http://www.mail-archive.com/debian-devel@lists.debian.org/msg277726.html
905 zoomsh: remove "debugging" output. Was added by mistake in 4.1.0.
909 Fix yaz-config output: echo_source not set correctly by configure.
913 Solr Web Service support for yaz-client and ZOOM.
915 Define record syntax JSON. OID: 1.2.840.10003.5.1000.81.3 .
917 --- 4.0.12 2010/08/17
919 Z39.50 facet support. Facet specifications are passed for search in
920 other-information with ASN.1 as defined in facet.asn and OID
921 .10.1000.81.5 . Facets are expressed as an Attribute list as known
922 from Type-1/RPN queries. Type 1 is field. Type 2 is sort order. Type
923 3 is limit (number of entries to get in response). yaz-ztest returns
924 dummy facets if a client asks for them.
926 --- 4.0.11 2010/07/09
928 CCL fixes: bug 2895 and bug 3539.
930 GR1-display: add comma in display - was removed by mistake in
933 Windows installer: bundle MSVCP90.dll - used by icuuc42.dll.
935 SRU: Merge cookies on HTTP redirects (Giannis Kosmas <kosmas@lib.uoc.gr>).
937 --- 4.0.10 2010/06/18
939 ZOOM C: Add ZOOM_resultset_release. ZOOM_resultset_release releases a
940 result set from a connection. The result set will be on its own
941 thereafter; no operations on it will perform retrievals from a target.
942 Only cached copies are returned.
944 ZOOM C:fix case for HTTP servers responding with Connection:close.
945 Ensure that if there is a current task it is resumed (like fetching
946 more records in a result set) . Bug #3484.
948 PQF parser: use odr_atoi for Odr_int (not atoi)
950 Minor PQF encoding and decoding changes; reformat. PQF decoding: attribute
951 values that contain any non-digits are treated as string attributes
952 (previously decoding only checked for leading character ([0-9]). PQF
953 encoding: attribute string values are not surrounded by double-quotes.
957 New utility for managing threads - thread_create.h.
959 Add socket pipe utility - spipe.h. The socket pipe has same purpose as
960 Unix pipe . Unfortunately Windows pipes do not work on select/poll -
961 but YAZ' implementation do.
963 Fixes for yaz_cond-functions on Windows 7.
965 DLL export more symbols.
967 zoomsh: show record do NOT render opac.
969 Remove *.la files from Debian and RPM packages.
973 Debian package libyaz-dev depends on libgnutls-dev again (was
974 removed in YAZ 4.0.6, but due to Libtool it is still needed
975 even though yaz-config do not list libgnutls libs).
977 ZOOM: Use only one WRBUF for returning string results for
978 ZOOM_resultset. Reduces memory usage for ZOOM in general.
980 ZOOM: ZOOM_connection do not use a shared pointer to
981 ZOOM_resultset after ZOOM_resultset is destructed by
982 user. Reverts to YAZ 4.0.4 behavior.
986 record-conv: fix problem with at least one XSL conversion -
987 due to probably incorrect usage of XML XSL documents.
991 Fix yaz-config for static mode and the use of SSL (gnutls).
995 Forward decl timeval struct in mutex.h and gettimeofday.h.
997 yaz-config: fix 'static' mode linking.
1001 Add functions yaz_cond_{create,destroy,wait,signal,broadcast}. These
1002 are wrappers for pthreads or Windows. For Windows these are put in
1003 a separate DLL: yaz_cond4.
1005 libyaz.la (whole source) is compiled with thread. If thread support
1006 is enabled enabled, all source of YAZ is compiled with treading support.
1007 This allows core utilities such as yaz_log to use thread facilities.
1008 Previously (YAZ 3 and YAZ 4 releases), only libyaz_server.la was using
1009 thread utilities. This commit moves mutex utilities (mutex.c) from
1010 libyaz_server.la to libyaz.la.
1012 yaz-json-parse displays leading text until error.
1014 --- 4.0.3 2010/04/09
1016 Handle HTTP redirect for SRU GET in yaz-client and ZOOM C. Based on
1017 patch from Giannis Kosmas.
1019 SRU: no longer URL encode SRU database. The URL for an SRU server is
1020 a URL and such is alreeady encoded - at least when given with leading
1021 http:// or https://. This reverts behavior to YAZ 3.0.50.
1023 Support for new MARC XML notation TurboMARC which like MARCXML is a
1024 complete representation of MARC/ISO2709.. This one, however, is more
1025 compact and allows for faster processing with XSLT. TurboMARC can be
1026 used in the marcdisp.h API, from the yaz-marcdump utility and from
1029 yaz-ztest can be configured - via the database - to perform certain
1030 delays when it performs operations search, present and single record
1031 fetch. This allows testers to make yaz-ztest act as a real or even slow
1032 Z39.50 server. Refer to the yaz-ztest man pages for details.
1034 --- 4.0.2 2010/03/09
1036 wrbuf_destroy allows NULL WRBUF passed to it.
1038 Fix CCL qualifier aliases (did not work since YAZ 2.1.56).
1040 Add ZOOM_connection_close.
1042 No fixed size buffers for ZOOM shell - bug #3257.
1044 tstodr: make it work on s390 platform.
1046 New icu iterator-functions. The new icu_iter-functions makes it possible
1047 to use ICU chains from many threads.
1049 yaz-client: better syntax check for show command.
1051 --- 4.0.1 2010/01/26
1053 New glob file pattern utility. Like POSIX glob. For Windows too. Refer to
1056 New simple local-file XML include facility which allows file glob-patterns.
1057 Refer to yaz/xml_include.h.
1059 Utility yaz-json-parse which parses JSON and demonstrates the JSON parser
1062 ZOOM_record_get supports new parameter "format" which makes it format XML
1065 Fix JSON parser WRT start symbol. The start grammar symbol (referred to as
1066 JSONText in ECMA-262) is JSONValue, not JSONObject.
1068 --- 4.0.0 2010/01/20
1070 Windows binaries for YAZ now compiled with Visual Studio 2008 (VC9).
1071 Older versions of YAZ was compiled with Visual Studio 6.0 (1998).
1073 Update so/DLL to version 4. Windows version builds YAZ4.DLL.
1074 POSIX/Unix builds .so with major version 4.
1076 Remove old LOG_-defines from log.h. They have been obsolete and
1077 undefined by default for the last 5 years.
1079 Odr_int is now of type 'long long'. Used to be 'int' in YAZ 3 series.
1081 GFS: Remove socket (int *fd) from search_rr handler. The socket
1082 descriptor ptr is a facility that allowed a search handler to supply
1083 a socket which would serve as a callback - when search was complete.
1084 This facility has now been in use for years.
1086 COMSTACK API changes: cs_stackerr, cs_addrstr. COMSTACK method cs_stackerr
1087 removed. It is not implemented by tcpip or unix COMSTACK, perhaps for ISO
1088 SR which was removed 7 years ago. COMSTACK macro / method cs_addrstr now
1089 returns 'const char *' rather than 'char *. The returned string is
1090 read-only and should not be modified by applications. COMSTACK cs_close is
1091 now a void function - it no longer returns int. No applications check for
1092 the value and the implementations has always returned 0.
1094 ZOOM: use size_t for scan hit counts and str size. Functions
1095 ZOOM_scanset_term and ZOOM_scanset_display_term have changed, so that
1096 occ (hit count) and len (string length) are now of type size_t pointer
1097 rather than int pointer. This is to be able to represent large hit counts
1098 and to also just to use the proper type for string length (strlen result).
1100 New JSON parser. Refer to include/yaz/json.h .
1102 WRBUF API changes.. For size parameters for WRBUF size_t is now used ..
1103 Used to be int in some cases. Many wrbuf_-functions used to return an int
1104 indicating some length.. These return values were never used. And so they
1107 ODR: odr_malloc, odr_total now takes size_t for size.
1109 clone_z_type: fix leak; occurred for encoding failures.
1111 --- 3.0.52 2009/12/03
1113 tcpip comstack: fix use of uinitialized variable in cs_straddr. This
1114 bug was introduced in 3.0.51.
1116 --- 3.0.51 2009/12/02
1118 tcpip comstack: Remove TCP receiver buffer optimizations for Solaris.
1120 tcpip comstack: fix leak for getaddrinfo.
1122 Encoding of SRU database is performed by yaz_encode_sru_dbpath_odr or
1123 yaz_encode_sru_dbpath_buf. Now used by yaz-client and the ZOOM API.
1124 Decoding of SRU "path" database is performed by private function
1125 yaz_decode_sru_dbpath_odr . This in turn is used by yaz_srw_decode
1126 and yaz_sru_decode in server applications, GFS, yazproxy, metaproxy.
1128 yaz-client: honor base command for SRU. Change when database setting
1129 is applied for SRU and ensure it is kept when a connection is reset.
1130 Change also the way errors are displayed or SRU (decoding of packages).
1132 --- 3.0.50 2009/11/02
1134 Add support for extra request / response data for SRU codecs and GFS.
1135 The Z_SRW_PDU structure has two new members extraResponseData_{buf,len}
1136 for extra data response buffer and length. For the GFS, both request
1137 and response data (XML) is carried in extra_args and extra_response_data
1138 for the search handler. Patch by Ko van der Sloot.
1140 ZOOM: For queries that cannot be converted to the specified rpnCharset,
1141 ZOOM now returns a diagnostic on the client-side ('invalid query' /
1142 10010). This fixes bug #2113.
1144 yaz-client fix: If cmdfile is passed to yaz-client (option -f) and that
1145 cmdfile included a 'quit' command that would result in a memory violation.
1147 --- 3.0.49 2009/10/01
1149 Make a number of functions defined in xmlquery.c static. These have
1150 never been declared in a public header file (yaz/xmlquery.h) and was
1151 made public by mistake.
1153 Improve speed of character conversions (iconv utilities). This makes
1154 conversions from MARC-8 faster.
1156 ZOOM_record_get returns 0 pointer if a MARC record can not be decoded -
1157 unless type desired is "raw". This will prevent type "xml" from
1158 returning ISO2709 .. Which obviously can not be XML parsed.
1160 Fix memory leak in ZOOM that would occur if option apdulog was used
1161 on a re-used connection.
1163 Frontend server logs HTTP requests.
1165 Frontend server now sends Z39.50 close when it times out (sesssion has
1166 been idle for too long). Versions 2.0.30 and earlier also sent close.
1167 But due to a mistake this was disabled in all versions after that, i.e.
1168 the server would just close the socket immediately.
1170 yaz-client emits a better message when receiving an unrecognised
1171 userInformationField.
1173 Skip zero-length subfields when decoding ISO2709. This rare case happens
1174 if a record has two FS characters in a sequence. Without this patch
1175 there would be a reference beyond char array in using_code_len fragments
1178 Fix yaz-marcdump error that would occur if option -n was used (bug #3028).
1180 --- 3.0.48 2009/08/28
1182 The show command offered by the zoomsh command now takes a 3d optional
1183 parameter type which is what is passed to ZOOM_record. If the type
1184 argument is omitted, "render" is used.
1186 RPN to CQL conv may use USE string attributes (bug #2978).
1188 MarcXchange NS is now info:lc/xmlns/marcxchange-v1 .
1190 --- 3.0.47 2009/07/08
1192 Function yaz_xml2query allows a diagnostic element in the PQF XML
1193 representation .. diagnostic@code and diagnostic@addinfo is diagnostic
1194 code and additional info respectively.
1196 The BER BOOLEAN is now the integral type Odr_bool which still happens
1197 to be an 'int'. The BER INTEGER which used to be a plain 'int' is now
1198 typedef'd to Odr_int. This is still an integral 'int', but it may be
1199 changed to 64-bit via a one-liner in nmem.h (NMEM_64=1). The documentation,
1200 ASN-1 compiler as well as programs has been updated to use the new types.
1202 --- 3.0.46 2009/06/08
1204 zoom: ZOOM_record_get now renders OPAC records when type=xml. Previously
1205 only the bibliographic record was rendered. For type=opac, an OPAC
1206 record is only returned if it is present.
1208 iconv: small fix for encoding of advancegreek.
1210 yaz-client: avoid double display of SRU/SRW records (bug #2798).
1212 yaz-client: option auto_reconnect=on really reconnects.
1214 yaz-client: fix bug #2770 - avoid length limit for auth parameters.
1216 server: avoid null ptr ref for for yaz_poll errors.
1218 build: fix RPM build for RHEL 5.3.
1220 comstack: prefer IPV6 addresses over IPV4 - should refix bug #2350
1222 --- 3.0.45 2009/03/31
1224 Fixed bug #2709: TCP connect returns Invalid argument.
1226 Fixed compilation for mingw.
1228 Honor charset for raw records (ZOOM_record_get).
1230 Fixed use of errno for threaded mode that was seen on Solaris 10.
1232 Fixed argument passing with blanks in value for Windows Service.
1234 Disable YAZ' own log rotate by default (no 1 GB limit).
1235 The variable l_max_size which specifies the log file limit is set to 0
1236 (DISABLED): This is due to the fact that YAZ is most often deployed using
1237 logrotate. Also YAZ can not perform log rotate because of unsufficient
1238 permissions (setuid).
1240 --- 3.0.44 2009/02/17
1242 List supported encodings in man page for yaz-iconv.
1244 Fixed missing SSL libs for --libs output
1246 Re-established OID record syntax application-xml. Nobody should use it
1247 but we don't want to change soname because of this symbol being absent.
1249 --- 3.0.42 2009/02/02
1251 YAZ' RPM spec works for both SUSE Linux Enterprise and RedHat Fedora.
1253 Added member named_result_sets for init handler struct for the GFS. This
1254 allows a server to disable named result sets.
1256 Removed OID record syntax application-xml.
1258 Added support for rule-based transliterator for ICU wrapper of YAZ.
1260 Fixed bug #1902: yaz-icu XML output.
1262 Make YAZ checks Emacs friendly.
1264 BITSTRING value shows value. Bug #2346.
1266 ISO2709 decoding: skip control characters from indicator data.
1268 Omit sort key by default in yaz-icu's output.
1270 Allow combined single char options (again) for YAZ' options function.
1272 Utility yaz-marcdump got option to display YAZ version (-V).
1274 Allow YAZ to use ICU 3.4.
1276 Added new ICU test case which illustrates removal of diacritics.
1278 --- 3.0.41 2008/12/29
1280 Fixed Fixed test that makes VERSION_SHA1 appear on dist versions too.
1282 --- 3.0.40 2008/12/29
1284 For configure, using option --without-xml2 also disables Libxslt/Libexslt
1287 Fixed bug #2352: yaz-marcdump crashes for certain record.
1289 Added man page 'bib1-attr' which includes list of common Bib-1 attributes.
1291 Added support for Danmarc2 to UTF-8 conversion.
1293 Added support for ISO5426 to UTF-8 conversion.
1295 zget_InitRequest/zget_InitResponse returns GIT SHA1 hash as part of
1296 implementation version.
1298 Function yaz_version returns GIT SHA1 hash for parameter sha1_str.
1300 --- 3.0.38 2008/11/10
1302 ZOOM C now only fires one ZOOM_EVENT_SEARCH per search-task. Previously,
1303 ZOOM_EVENT_SEARCH was fired for each searchRetrieve Response received.
1305 ZOOM C now interprets databaseName option for ZOOM connection as path
1308 Windows version bundled with Libxml2 2.7.1 / Libxslt 1.1.24 / ICU 4.0.
1310 Fixed CCL to RPN/PQF conversion which could result in invalid PQF.
1312 Dummy Libxml2 types no longer defined in headers of YAZ'.
1314 Fixed memory violation for ZOOM C - could occur when SRU diagnostics was
1317 --- 3.0.36 2008/09/26
1319 Various ODR chapter fixes.
1321 Windows version uses libxml2 2.6.32+, libxslt 1.1.23+ and ICU 4.0.
1323 Added missing source for Windows compilation, mutex.c.
1325 Fixed compilation of YAZ for Visual Studio 2008. Bug #2256.
1327 For SRU connections in ZOOM all records up to "count" are now fetched.
1329 Fixed crash in generic frontend server (and yaz-ztest) which occurred
1330 in Windows due to bad error handling for Libxml2.
1332 Added facility for sending arbitrary records (ASN.1 any) using
1333 ZOOM C's Extended service update. Patch by Sam Reynolds.
1335 New options for ZOOM C's connection, logapdu which makes ZOOM log
1338 --- 3.0.34 2008/06/18
1340 YAZ uses GNU TLS without the OpenSSL compatibility wrapper.
1342 --- 3.0.32 2008/06/12
1344 Fixed memory violation that could occur when decoding UTF-8. This bug
1345 was only present in 3.0.30 of YAZ.
1347 --- 3.0.30 2008/06/06
1349 Implemented SSL sockets using GNU TLS. OpenSSL is still supported, but
1350 GNU TLS is used by default (if found).
1352 yaz-ztest returns OPAC records if a client asks for OPAC.
1354 Improved speed of MARC-8 encoding.
1356 Added support for lossy and loss-less MARC-8 encoding.
1358 Changed yaz_record_conv_record to be reentrant for XSLT conversions.
1360 Added new Windows Service wrapper (sc).
1362 yaz-client's itemorder command may now send a file.
1364 Fixed yaz-marcdump to allow the use of NS prefix for record element.
1366 Added new function yaz_log_xml_errors.
1368 Allow (but warn) unknown XML attributes in MARCXML parsing.
1370 Handle G1 sequneces in MARC-8 decoding. Bug #2115.
1372 The UTF-8 to MARC-8 conversion now uses a different set of characters
1373 for Greek symbols. Bug #2120.
1375 --- 3.0.26 2008/02/21
1377 Added yaz_daemon (daemon.h).
1379 Fixed bug #2068: pkg-config trouble
1381 Fixed bug #395: ZOOM_record / OPAC record encoding problems.
1383 --- 3.0.24 2008/01/28
1385 Document --with-xml2 option.
1387 Added OPAC XML XSD (etc/opacxml.xsd).
1389 Allow glob mask for name attribute in retrieval element for the
1390 generic frontend server's retrieval facility.
1392 Changed yaz_poll_poll to return yaz_poll_except for all returned events
1393 except POLLIN/POLLOUT.
1395 Fixed error handling in cs_listen. Bug #2037.
1397 --- 3.0.22 2008/01/20
1399 Fixed version in yaz/yaz-version.h.
1401 Fixed bug #2027: Crash when closing connection.
1403 Changed configure so that ICU support is only enabled if only ICU
1404 and Libxml2 is available (because the ICU chain is XML based).
1406 --- 3.0.20 2008/01/15
1408 YAZ now makes ICU utilities for Windows. A separate DLL, yaz_icu3.dll,
1409 is built. Only this DLL depends on the ICU runtime.
1411 yaz-ziffy is no longer part of YAZ. It is distributed separately by
1412 Index Data because ziffy's license is GPL2 rather then 'Revised BSD'.
1414 Changed license of CCL module to 'Revised BSD'. After consultation with
1415 remaining members of the original EUROPAGATE consortium, we are re-issuing
1416 the CCL module without a separate license. The software was developed by
1417 Index Data as part of a research project. The special license was included
1418 to help feed usage information back to the project consortium to support
1419 project evaluation. At this time, the project consortium has long-since
1420 disbanded, and the majority of the original principals have retired. At the
1421 same time, we have significantly modified the software during the following
1422 years, to the point where very practically no original code remains. To
1423 simplify re-use of the software, we have contacted those members of the
1424 consortium who could be reached, and agreed to re-issue the module as a
1425 proper part of the YAZ package.
1427 Tcl scripts uses /usr/bin/tclsh as preferred shell.
1429 CQL closer to being version 1.2 compliant. CQL also allows free-form
1430 terms, such as 'title=a b', and thus, make the CQL parser more CCL-like
1433 Fixed bug in ZOOM_options_getl WRT setting of parameter lenp. This
1434 bug could make Extended services handling crash in the ZOOM layer. This
1435 bug was only present in YAZ 3.0.18.
1437 --- 3.0.18 2007/12/19
1439 ziffy uses YAZ' options rather than getopt; getopt is unavailable on
1442 yaz-marcdump reads and writes collection wrapped records.
1444 Handle OPAC for record conversion module.
1446 Fixes for ICU wrapper.
1448 Allow ICU libs to be controlled with --with-icu .
1450 --- 3.0.16 2007/11/12
1452 Added yaz_poll which is a wrapper for select/poll. When poll is available
1453 and non-buggy, it is used, by yaz_poll . This allows more than 1024
1454 sockets to be in use.
1456 Added ICU wrapper library which exposes ICU http://www.icu-project.org/
1457 functionality through an XML based configuration (ICU chain). This system
1458 is useful for search facilities such as Pazpar2 and Zebra that needs to
1459 perform tokenization of indexed material. The ICU code in a separate
1460 library libyaz3_icu.a.
1462 Added HTTP tunnel facility for COMSTACK, bug #1752.
1463 This is a facility that allows a Web proxy, such as squid, to tunnel
1464 Z39.50 traffic. This facility is "transparent" to must applications
1465 using YAZ. It's enabled by using pseudo transport connect: followed by
1466 the proxy address, followed by command, then follwed by he regular
1467 "virtual" addresss. For example,
1468 connect:webproxy.com:3128,tcp:z3950.loc.gov:7090/voyager .
1470 More MARC-8/UTF-8 conversion fixes. Bugs #1666, #1667, #1778.
1472 --- 3.0.14 2007/09/21
1474 Fixed bad memory reference in ZOOM_record - cuased by member not being
1475 initialized. This was a problem only in YAZ 3.0.12.
1477 Fixed bug in conversion from MARC to XML: Non-XML characters in control
1478 fields were not removed.
1480 Changed the way C code is generated from codetables.xml. Made a MARC-8
1481 conversion trie for each characterSet section rather than codeTable.
1482 This is ensure the code can deal with G0/G1 sequences. Use of a newer version
1483 of codetables.xml from Larry Dixson, LOC. Bug #1464.
1485 --- 3.0.12 2007/09/12
1487 ZOOM C now handles SRU surrogate diagnostics (i.e. errors returned
1488 from ZOOM_record_error).
1490 ZOOM C function ZOOM_record_get returns record schema for type="schema".
1492 Implemented HTTP Basic authentication to SRU/GET, SRU/POST and SRW requests.
1494 Added new ZOOM C connection option 'sru_option' which specifies SRU version.
1496 Better SRW-to-Bib-1 diagnostic mapping.
1498 ZOOM C and yaz-client announces SRU version 1.2 by default.
1500 yaz-client 'sru' command may specifiy both SRU version and transport (SOAP,
1503 Fixed in yaz_sru_decode to allow other version than 1.1.
1505 --- 3.0.10 2007/08/22
1507 Added support for SRU scan for ZOOM.
1509 Added support for the use of the older versions or Extended Service
1510 Update in ZOOM. To faciliate this, an option "updateVersion" may be
1511 set to the version , 1=first, 2=second, 3=third. The third version is
1512 what ZOOM C has used so far. And that, obviously, is the default.
1514 Added support for CCL queries in Z39.50 queries sent to the GFS (and
1515 therefore in Zebra and in SimpleServer-based applications). The new
1516 <ccl2rpn> element in a GFS configuration file, if present, names a CCL
1517 qualifier file used to transform incoming CCL queries into Type-1 RPN,
1518 which is passed into the back-end search callback function.
1520 Added support for HTTP Basic authentication in clients: the SRU/W
1521 codec encodes the username/password elements of the PDU structure
1522 appropriately, and these may be set using the "user" and "password"
1523 options in ZOOM-C applications (the same options that are used for
1524 Z39.50 authentication).
1526 --- 3.0.8 2007/06/25
1528 Fixed bug #1208: SSL appears to be broken in ZOOM.
1530 Fixed bug #1206: Libxml2 include path weirdness.
1532 Added oid_name_to_dotstring.
1534 Allow elementSetName to be specified for ZOOM C record update.
1536 Allow waitAction to be specified for ZOOM C based for Extended Services.
1538 Fixed NULL ptr reference bug in yaz-ztest - caused by omitted record
1539 syntax OID. Bug introduced in YAZ 3 series.
1541 Updated WIN32 build to include Libxml2 2.6.28 / Libxslt 1.1.19.
1543 --- 3.0.6 2007/06/06
1545 Fixed bug #1157: yaz-client does not read .yazclientrc from current
1546 directory. yaz-client now reads commands from file given by option -f
1547 if specified; then tries to read .yazclientrc in current directory.
1548 Failing that, it reads .yazclientrc from user's home directory.
1550 Added support for correlationInfo Note and ID for Record Update via
1553 Added yaz-client command querycharset which specifies character set for
1554 query terms for Z39.50 RPN queries and Z39.50 Scan Requests
1555 (termListAndStartPoint).
1557 Charset ISO5428:1984 is an alias for ISO5428-1984.
1559 Implemented a way to perform scan in a result set using Z39.50. This
1560 is achieved by attaching the result set name in the characterInfo
1561 (type InternationalString) of OtherInformation in the Scan Request PDU.
1562 The result set is identified in the otherinformation by the new OID:
1563 USERINFO, Z3950_PREFIX.10.1000.81.4, "Scan-Set
1564 This allows for scan in result set and faceted search . Zebra did some
1565 of this in the APT term using attribute type 8 and value being result
1566 set. Using the OtherInformation approach for this is cleaner and easier
1567 to work with in proxies and the like. This facility can be used in
1568 yaz-client using new command setscan which takes a result set as first
1569 argument, start position (APT) as second.
1571 Changed decoding of SRU XML packed records to deal with servers that
1572 have recordData with XML data with multiple root nodes. Also make
1573 comparison for recordPacking case insensitive. Again, one server
1574 returns "XML" where others return "xml".
1576 For SRU responses allow Content-Type application/xml as well as text/xml.
1578 --- 3.0.4 2007/05/21
1580 Fixed bug in character set conversion of BER strings. Bug introduced
1583 --- 3.0.2 2007/05/08
1585 For OIDs use Odr_oid type everywhere, i.e. do not assume Odr_oid=int.
1587 For OID class, use oid_class consistently.
1589 Fixed external handling for SUTRS and Explain records (bug appeared in 3.0
1592 Added partial support for ISO5428-1984, which is the "Greek alphabet coded
1593 character set for bibliographic information interchange". By Giannis Kosmas.
1595 Added documentation on new OID API.
1597 --- 3.0.0 2007/05/02
1599 Changes to generic frontend server interface: added new member
1600 'query_charset' for bend_initrequest structure. A backend init handler
1601 should set this member to its native character set for query terms.
1602 When defined, the frontend server logic will announce this character set
1603 to a client if the negotiationModel bit is set by the client. All server
1604 implementors are encouraged to specify this. If a backend server does not
1605 specify this a warning is issued using yaz_log(YLOG_WARN,..).
1607 Added CCL utility to remove terms (stop words) from resulting RPN
1608 tree. This is handled by functions with prefix ccl_stop_words_ .
1610 New ZOOM C option, "rpnCharset", which allows client-side conversion of
1611 terms in RPN queries.
1613 Clean-up the CCL API. Moved some internal structures from ccl.h to
1614 private header cclp.h. Changed ccl_parser_create so that a Bibset must
1615 be supplied. Removed tokenize API from ccl.h - including ccl_parser_find.
1616 This is replaced by ccl_parser_find_str which takes a string instead.
1618 Split YAZ library into two libs : libyaz.la and libyaz_server.la.
1619 libyaz.la is the core of YAZ except the generic frontend server and
1620 does not depend on POSIX threads anymore. libyaz_server.la is the
1621 generic frontend server facilities and uses POSIX thread functionality
1622 if available. The libyaz.la no longer depends on POSIX threads because
1623 the number of global structures is limited. NMEM no longer re-uses blocks
1624 between threads ; it simply free's memory immediately but allocates in
1625 "large" chunks as usual. We don't expect any performance penalties
1626 because of this. The yaz_log system is still using a global log_level so
1627 caution must be taken when modifying it with yaz_log_init_.. +
1628 yaz_log_mask_str. This, however, should not cause any trouble because
1629 these functions are called during initialization of application code
1630 anyway. `yaz-config --libs server` returns libs for server applications;
1631 `yaz-config --libs` returns libs for non-server applications.
1633 New OID database - with public definitions in oid_db.h. Removed old OID
1634 database including the head oid.h and definitions such as enum oid_value
1635 and struct oident. The new OID database uses the same string names as
1636 before but the 'protocol' is gone. There are now only two representations
1637 raw OID (int *) and string. Functions with prefix yaz_string_to_oid
1638 converts from string to OID; functions with prefix yaz_oid_to_string
1639 converts the other way.
1641 Change to emit_term() in CQL-to-PQF query translation: when a term has
1642 the /regexp relation modifier, do not process it for leading and
1643 trailing "^" and "*", which have quite different meanings in regular
1646 Attempted fix of bug #976: Segfault in yaz_iconv. The yaz_iconv function
1647 write handlers no longer carries a 'last' parameter. This will make
1648 yaz_iconv flush "less" characters. A flush is performed by call to
1649 yaz_iconv(cd, 0, 0, &outbut, &outbytesleft) .
1651 Definition of wrbuf_diags moved to querytowrbuf.h. Function wrbuf_put_zquery
1652 removed, because function yaz_query_to_wrbuf does the same.
1654 API changes to WRBUF. wrbuf_free removed; replaced by wrbuf_destroy. And
1655 wrbuf_puts no longer appends '\0'. Use wrbuf_cstr to get C-string out.
1657 Deprecated MARC utility functions removed.
1659 Changed prototype of yaz_marc_decode_buf: const char for result and size_t
1662 Branch split: YAZ_2_1_55_branch
1664 --- 2.1.54 2007/03/16
1666 Fix to ZOOM-C so that transparent reconnection is properly handled on
1667 connections that are in asynchronous mode.
1669 Fixed compilation on OpenBSD 4.0.
1671 Large strings in GRS-1 records are now properly displayed in yaz-client.
1673 Added character conversion support for "advancegreek"; based on patch from
1676 Fixed yaz_iconv to return YAZ_ICONV_EINVAL if an incomplete MARC-8 combo
1677 sequence is met. Before the error was not set so it would be unknown.
1679 Adjust yaz-marcdump MARC reader so that it skips until record separator
1682 --- 2.1.52 2007/03/07
1684 ZOOM-C: Removed hardcoded limit of 1024 sockets in ZOOM_event_sys_poll().
1685 Note that ZOOM_event_sys_select() still has the limit due to the fixed-size
1686 fd_set structure used as a bitmask for the FDs to be selected on.
1688 Using ACX_PTHREAD macro to check for POSIX threads.
1690 Fixed have-vsnprintf check.
1692 --- 2.1.50 2007/02/23
1694 Fixes for configure on BSD. Bug #900.
1696 Added snprintf/vsnprintf wrappers for systems that don't have
1697 limits (heavens forbid).
1699 Fixed bug in ZOOM-C's event and task handling. If a ZOOM task was
1700 created before all previous tasks were completed and removed from the
1701 task queue, the new task could be removed by a mistake.
1703 Fixed bug #615: Document retrievalInfo facilities for Frontend Server.
1705 Implemented pass-through CQL-to-PQF conversions. Bug #861.
1707 Fixed bug #832: Problem with MARC/charset in yaz-client.
1709 Fixed bug #668: save command line history for yaz-client.
1711 Fixed bug #830: pkg-config support.
1713 --- 2.1.48 2007/01/23
1715 Extended ZOOM result set options with two options that may be read by
1716 a client: resultSetStatus and presentStatus with values as specified for
1718 http://www.loc.gov/z3950/agency/markup/04.html#Search-status
1720 Fixed bug #827: Using SSL fails on Debian etch.
1722 Fixed bug #826: Weird looking chars for set of MARC records.
1724 Implemented alternative Item Order package for ZOOM. If option "doc" is set,
1725 that is treated as an ItemOrder with itemRequest being an XML document
1726 external. The value of "doc" is the content.
1728 Extended the GFS search facility. New member of bend_search_rr
1729 'estimated_hit_count' signals that hits is known to be an estmate
1730 (higher or lower than real hit count). New member 'partial_resultset'
1731 signals that the search was partial (hit count is lower or equal than
1732 real hit count). For Z39.50, the information is stored in resultSetStatus
1733 member of SearchResponse APDU. For SRU, the information is signalled
1734 via SRU diagnostic 59: "Result set created with valid partial results
1737 Switched from jade/pdfjdaetex to dblatex for Docbook documentation in PDF.
1739 --- 2.1.46 2007/01/13
1741 Implemented bug #806: Deal with HTTP clients sending LF in HTTP headers.
1743 Added ZOOM_connection_peek_event.
1745 Implemented Generic select hook for ZOOM (bug #803). This is achieved with
1746 the following new functions:
1747 ZOOM_event_nonblock, ZOOM_connection_process,
1748 ZOOM_connection_get_{socket,mask,timeout},
1749 ZOOM_connection_fire_event_{timeout,socket}.
1750 The existing blocking event handler, ZOOM_event, is a wrapper for the
1751 + blocking ZOOM_event_sys_{poll,select}.
1753 Implemented function ccl_xml_config which parses XML version of CCL
1754 configuration (bug #798).
1756 Fixed bug #797: yaz_marc_write_xml does not honor character conversion.
1758 Added timings utility (yaz/timing.h)
1760 --- 2.1.44 2007/01/03
1762 Added yaz_marc_write_xml which creates MARCXML/MarcXchange record as
1765 Fixed bug #779: Rotation of apdu.log fails.
1767 Fixed for character set conversions:
1768 Unicode to MARC-8 conversion for certain less preferred UTF-8 sequences.
1769 Honor G1 set in MARC-8 decoding.
1771 --- 2.1.42 2006/12/17
1773 Fixed bug #775: char conversion does not handle Alternative UTF-8
1776 Implemented function yaz_marc_read_line which parses MARC line format
1777 records. There is a wealth of formats out there. So far, this function
1778 reads line records produced by yaz_marc_write_line.
1780 yaz-marcdump's options -x, -X, -I, -e have been replaced with the
1781 more generic and easier to remember(!) options: -i format and -o format
1782 which specifies input format and output format respectively - where
1783 format is one of "marc", "marcxml", "line", "marcxchange".
1785 Added 'check only' option for MARC utilities. Option -n for yaz-marcdump
1786 does not print anything except warnings for records.
1788 For yaz-marcdump, added support for MARC split into files (-s) with a given
1791 Changed the SRU update structures and codecs to reflect the SRU pre 1.0
1792 spec, at http://www.loc.gov/standards/sru/record-update/
1793 This has changed the binary layout of the following structs:
1794 Z_SRW_extra_record, Z_SRW_updateRequest, Z_SRW_updateResponse and
1795 bend_update_rr . Patch by Ko van der Sloot.
1797 Added GFS utility function bend_assoc_is_alive which returns 1 if
1798 association is still alive (client is connected); 0 otherwise (client
1799 closed connection). This allows busy servers to stop working for
1802 Added ziffy: the promiscuous Z39.50 APDU sniffer. until now, ziffy has
1803 been a separate piece of software. This version of ziffy has been modified
1804 to fit with YAZ. ziffy is copyright Rocco Carbone and covered by GPL v2.
1806 Fixed bug #740: Handle SRU records referring to xmlns's outside recordData.
1808 Fixed bug #722: Allow Z39.50 Init Options to be specified / retrieved.
1809 Client code may now interrogate options such as "init_opt_sort" to
1810 find out whether the server claims to support various options.
1812 --- 2.1.40 2006/11/27
1814 Added utilities yaz_{set,get}_esn to set/get element set name from
1817 Removed the build of libyazthread.la. The libyaz.so is the threaded version
1818 of YAZ and has been so since YAZ 2.1.10.
1820 Implemented ZOOM_record_error which returns error information for
1821 record (surrogate diagnostic).
1823 --- 2.1.38 2006/10/31
1825 Updates for SRU Update by Ko van der Sloot:
1826 1. Changed name from "operation" to "action"
1827 2. Fixed that that "recordIdentifier" was called "recordId". Kept the old
1828 versions in the code, marked as 'backward compatible'.
1829 3. Added diagnostics for SRU Update.
1831 Fixed bug #709: Records are fetched in wrong format when tasks are queued.
1833 Fixed bug #707: CQL->RPN ignores lines with leading spaces.
1835 Fixed bug #706: XML hex encoding UTF-8 chars out of range 0-255.
1837 For GFS, fixed problem with SRU diagnostic 'First record position out of
1838 range' being issued for 0 hits.
1840 zoomtst10 part of Windows Build.
1842 --- 2.1.36 2006/10/13
1844 Implemented yaz_filepath_comp which splits a path into file path
1845 components (required by Zebra 2.0.3+).
1847 Change wording of YAZ license to the 'Revised BSD License'. YAZ has used a
1848 BSD inspired license until now so this should not have any real impact on
1849 anybody. See http://www.opensource.org/licenses/bsd-license.php
1851 Fixed bug #687: Missing log lines.
1853 Fixed bug #678: CQL to PQF translation does not preserve double-quote
1856 Fixed bug #689: SRU diagnostics to be added.
1858 Implemented new ZOOM function, ZOOM_connection_is_idle, which checks
1859 whether a connection is idle (no more work do do).
1861 --- 2.1.34 2006/10/04
1863 Change type of optval from long to int for invocation of setsockopt with
1864 the SO_REUSEADDR option. Thanks to Ateeq A. Altaf, Talis.
1866 Added support for specifying the max log file size for the Generic
1867 Frontend Server. The size is given with option -r.
1869 --- 2.1.32 2006/09/21
1871 Fix problem introduced in YAZ 2.1.28 WRT unix sockets in the ZOOM code.
1873 --- 2.1.30 2006/09/17
1875 Fixes for getaddrinfo use, Bugs #655 + #660. These bugs were introduced
1878 Fixed bug in Generic Frontend Server that could cause a server to stop
1879 accepting new connections. Bug only seen on dual CPU Windows 2003 server.
1881 For the generic frontend server, the maximum record size is used as maximum
1882 size of incoming packages (SRU + Z39.50). The value until was previously
1883 only used in Z39.50 Init negotiation and, later, in a session controlled
1884 sizes of records returned. This is controlled using -k option. It can be
1885 specified, per server, with element maximumrecordsize in YAZ' GFS XML config.
1887 --- 2.1.28 2006/09/04
1889 TCP/IP comstack uses getaddrinfo now to resolve names. It should be IPV6
1892 Fixed bug #644: Using Non Reentrant gethostbyname causes SIGSEGV.
1894 New option for yaz-marcdump -lpos=value which allows setting a portion
1895 of MARC header to a certain value.
1897 Fixes for MARC generation when encoded as MARC-8 (bug 642, 643).
1899 ZOOM-C reads option extraArgs. If set the value of extraArgs is appended to
1900 SRU URI (POST/GET). Value must be URL encoded, such as x-id-a=v1&x-id-b=v2 .
1902 --- 2.1.26 2006/08/15
1904 Fixed problem with SRU mode type (soap, get, post) for yaz-client
1907 Fixed problem another problem with ZOOM_EVENT_RECV_RECORD . Bug #626.
1909 --- 2.1.24 2006/08/08
1911 Fixed MARC ISO2709 encoding routines to deal with character set
1914 Minor changes to GFS logging. Database included in search request log
1917 Fixes for ZOOM-C: event ZOOM_EVENT_RECV_RECORD was not generated for
1918 cached/multiple records.
1920 Shared libraries are built by default on Unix+configure.
1922 Changed cql2pqf transformation to use a different evaluation order. The
1923 new order is: always, relation, structure, position, truncation, index
1924 and relationModifier. Old order was: always, relation, relationModifier,
1925 structure, index, position, truncation. Note that the the latter ones
1926 override former ones for identical attributes.. The new scheme means that
1927 it is possible to override any existing attribute with a relationModifier.
1928 And also that it is possible to override everything for the index rule
1929 (except the ones listed in relationModifier). No order is perfect but this
1930 one, we believe, covers more real cases.. The "always" should have been
1931 called "default", since the attributes there can be overridden with all
1934 For Libxml2 and friends, YAZ defines YAZ_HAVE_{XML2,XSLT,EXSLT) in the
1935 compilation phase, but also for yaz-config --cflags output. This allows
1936 us to have public headers with Libxml2 stuff in them . It should also,
1937 eventually, make Libxml2 checks redundant in packages using YAZ, such
1940 --- 2.1.22 2006/06/15
1942 Changed SRU update structure bend_update_rr so that SRU diagnostics are
1943 stored in uri, message and details.. Previously diagnostics were stored
1944 in errcode, errstring. Patch by Ko van der Sloot. Breaks binary
1945 compatibility.. but he's probably the only one affected, so.
1947 Added support for CCL, compiled on the client side, in ZOOM-C. This
1948 is invoked using ZOOM_query_ccl2rpn() with the CCL configuration as
1949 input; the resulting query objects can be used for for searching with
1950 ZOOM_connection_search() and scanning with ZOOM_connection_scan1().
1952 YAZ' configure searches for OpenSSL by default.
1954 SSL comstack uses SL_CTX_use_certificate_chain_file rather than
1955 SL_CTX_use_certificate_file. See
1956 http://lists.indexdata.dk/pipermail/yazlist/2006-June/001615.html
1957 for more info. Thanks to Ko van der Sloot.
1959 --- 2.1.20 2006/06/02
1961 Bug #600: SRU GET, POST support for yaz-client. Introduced
1962 command 'sru' which selects method SOAP/GET/POST.
1964 Allow missingValueAction to be specified for the sortspec string -
1965 function yaz_sort_spec. By default, the missing value action is null.
1966 Use ! to specify "abort". Use = followed by stringvalue to specify default
1969 Ensured that Present-handler (if defined) is called in GFS before any call to
1970 fetch-hhndler. This now includes piggy-backed presents as well as SRW/U
1971 searchRetrieve requests.
1973 Documentation for YAZ is now based on the Docbook XML/XSLT using
1974 xsltproc + N Walsh's stylesheets. It means that the CVS version of YAZ
1975 is no longer depending on jade/openjade or docbook-to-man scripts.
1976 PDF is no longer part of the distribution - but can optionally be
1977 made using DSSSL/jadetex or FOP.
1979 Added retrieval handling support in Generic Frontend Server to support
1980 conversion between MARC/XML as well as XSLTtransforms. See
1981 etc/yazgfs.xml for an example.
1983 Added Authentication support to Generic Frontend Server in SRU
1984 mode. Authentication using HTTP Basic is supported, as is the use
1985 of 'x-username' and 'x-password' parameters in the request itself.
1987 Added support for a new character set MARC8s identical to MARC8 except
1988 that it converts combined characters to single Unicode characters in the
1989 Latin-1 range (when possible).
1991 --- 2.1.18 2006/04/24
1993 ASN.1 compiler 0.4: generates brief Doxygen file header for
1994 generated .h/.c files.
1996 Utility yaz_iconv now supports conversion to MARC-8.
1998 New facilities for the MARC module. The reading - and writing of
1999 content are separate methods for the yaz_marc_t handle. The following
2000 read functions are available: yaz_marc_read_iso2709 (Reads MARC in
2001 ISO2709 format), yaz_marc_read_xml (reads MARC in MARCXML/MarcXchange
2002 format). Write functions have prefix yaz_marc_write_.. The existing
2003 utilities yaz_marc_decode_wrbuf and yaz_marc_decode_buf are still
2004 available. Removed support for OAI-MARC and simplexml (not the
2005 simplexml from PHP5).
2007 Added a new ZOOM event type ZOOM_EVENT_END which signals no more events
2008 to be returned for this connection.
2010 --- 2.1.16 2006/03/31
2012 Allow multiple languages and charsets to be specified with
2013 yaz-client. Each item must be separated by comma (NO BLANKS). E.g.
2014 negcharset iso-8859-1,utf-8
2016 Translation of proximity nodes from CQL into PQF now works.
2018 Moved to automake 1.8, 1.9.
2020 Added function yaz_log_set_handler which allows a log handler to be
2021 installed. This handler will be called for all log messages. Output
2022 to file is also produced; but that can be disabled by passing NULL
2023 fname to yaz_log_init_file.
2025 Fixed another problem with MARC-8 -> ISO-8859-1 conversions. Bug #537.
2027 For SRW (including GFS), accept application/soap+xml as content-type
2030 For GFS in SRU mode, an empty stylesheet in SRU URL (&stylesheet=&)
2031 produces NO stylesheet reference even if a default stylesheet is specified
2034 --- 2.1.14 2006/03/14
2036 Updated Windows package to include yazd.dll + yazd.lib for the
2037 Development component.
2039 If the environment variable YAZ_LOG is set, then it is used as a
2040 string indicating the default level of logging to use if not
2041 overridden by calls to yaz_log_init() or yaz_log_init_level(). If
2042 it's not defined, then the manifest constant YLOG_DEFAULT_LEVEL is
2043 used as before. So, for example, to omit warnings from YAZ logging,
2044 export YAZ_LOG=-warn
2046 cql_transform() now map structure and other attributes before indexes,
2047 so that index-specific structures and other attributes can override
2048 defaults. So now a combination of mapping specifications such as:
2050 index.dc.date = 1=date-modified 4=5
2051 does the right thing.
2053 cql_transform() now also respects the "always" mapping specification,
2054 which establishes an initial set of attributes to be used for all
2055 terms except where overridden by more specific attributes associated
2056 with the index, relation or modifier.
2058 Added SRU-GET and SRU-POST support for ZOOM C. Option "sru" specifies
2059 which mode to use; one of "post", "get" or "soap" (SRW, default).
2061 Fixes for yaz_iconv routines: changed trie-based character set conversions
2062 to use only non-negative values for bit fields due to Sun's C compiler not
2063 supporting negative values.
2065 Fixed bug in character set conversion yaz_iconv. Some three byte UTF-8
2066 sequences where not read correctly. Fix by Rustam Usmanov.
2068 Updated win/makefile to use options, settings which makes things
2069 compile with VS C 2005.
2071 --- 2.1.12 2006/02/01
2073 Fixed bug in yaz_oi_update which used incorrect value for categoryValue.
2075 In ZOOM socket code, use select instead of poll on MacOSX.
2077 ZOOM-C now support client-side compilation of CQL into RPN that is
2078 sent to the server, enabling CQL to be used against all Z39.50
2079 servers. Use ZOOM_query_cql2rpn() to set the compiled CQL into a
2080 ZOOM_query object, and submit it using ZOOM_connection_search().
2081 The CQL-to-RPN translation uses a configuration file, the name of
2082 which must be specified in the Connection's "cqlfile" option.
2084 ZOOM-C also support CQL scanning, via the new ZOOM_connection_scan1()
2085 function, which takes as its start-term parameter a ZOOM_query object
2086 (which may have had either CQL or RPN set into it).
2089 --- 2.1.10 2005/11/29
2091 Added ZiNG Update Support. New codecs are defined in srw.h. Extended the
2092 GFS to support this as well. Backend handler, bend_srw_update, does the
2093 update work. Code contributed by Ko van der Sloot.
2095 Allow retrieval of Search Result-1 information in ZOOM by the use of
2096 options that are attached to a result set. ZOOM documentation updated
2099 Fixed bug #416: First/second comb characters not handled in the MARC-8 to
2100 UTF-8 conversion. Patch by Raj Patel.
2102 Added option -m to GFS to control formatting of timestamps in log file.
2104 Added 'exit' as synonym for 'quit' in yaz-client
2106 Added support for specifying SRW resultSetId + resultSetIdleTime in a
2107 Generic Frontend Server's search handler. Refer to include/yaz/backend.h
2108 for the new members. Patch by Ko van der Sloot.
2110 Added support for SRU POST. It is supported for content-type
2111 application/x-www-form-urlencoded only. Patch by Ko van der Sloot.
2113 Do not build the separate Multi-threaded (MT) library libyazthread.la.
2114 Instead make the library libyaz.la multi-threaded. Threading as a whole
2115 can still be disabled by configure option --disable-threads. Previosly,
2116 with older GLIBCs there were problems with MT libs under Apache. This
2117 has now been fixed a long time ago.
2119 Fixed bugs in yaz_log that occurred on Sparc Solaris in Multi-threaded
2122 CQL module modified to be case insensitive for relations/indexes/operations.
2124 Fixed bug in CQL transform code: incorrect value relationModifieder
2127 Added 'show all' command for yaz-client which retrieves all results
2130 Added new yaz-client, xmles, which takes a (private) OID and
2131 a document to be sent as an extended service request.
2133 Describe new yaz-client commands wait_response and set_auto_wait.
2135 Increase TCP/IP listener backlog from 3 (which I am guessing was
2136 copied from the SunOS manual entry way back when) so SOMAXCONN, so
2137 that the socket will queue as many incoming connections as it's able
2138 to handle ongoing connections. In other words, it will never now
2139 refuse a connection that it would be able to handle merely because
2140 it's not got around to accepting() enough of the pending connections
2141 yet. This is the behaviour anyway under Linux, where the listen()
2142 argument is ignored; but not under BSD and on systems such as
2143 MS-Windows that use BSD-derived TCP/IP stacks. The behaviour of
2144 YAZ-based servers should now be uniform across operating systems in
2147 yaz-marcdump uses 64-bit file access on some systems. This is enabled
2148 on Linux and other Unix variants where _FILE_OFSET_BITS=64 is supported.
2149 This allows yaz-marcdump to read large MARC batches (>2 GB).
2151 Modified all YAZ source files - except the source which is auto-generated
2152 by tools - to use spaces rather than TABS. Emacs/VIM trailer added to
2155 Add ZOOM_connection_option_getl() and ZOOM_options_getl(),
2156 corresponding to the existing *_setl() function. These allow option
2157 values containing arbitrary valuues.
2159 Add ZOOM_resultset_sort1(), which should ALWAYS be used in place of
2160 ZOOM_resultset_sort() in new applications. Its behaviour is identical
2161 except that it returns an indicator of whether or not the sort
2162 criterion was accepted (0 for OK, -1 for invalid).
2164 --- 2.1.8 2005/06/07
2166 Fixed bug in yaz_marc_decode_buf. By mistake the routine appended
2167 MARC output rather than returning "new" buffer.
2169 yaz-client warns about unknown init options.
2171 Fixed bug #371: "options concurrentOperations ignores concurrentOperations"
2173 --- 2.1.6 2005/05/24
2175 Added support for SRW sort in Generic Frontend Server. Patch
2176 by Ko van der Sloot. Member srw_sortKeys in bend_search_rr holds
2177 sortKeys - or NULL if none is provided.
2179 Fixed bug #307: It was impossible to specify indefinite/no timeout
2180 for ZOOM_event. Special timeout value -1 now means indefinite timeout
2183 Added support for multiple languages and charsets to be specified in
2184 ZOOM. Each charset/language is separated by a blank. If negotiation is
2185 in effect in init-response, Option
2186 "negotiation-charset-in-effect-for-records" set to 1(true) or 0(false).
2187 Code based on patch by Vasiliy Osadchuk.
2189 Fixed bug #306: infinite recursion that occurred when calling
2190 yaz_log_level_init as the first call (before other log level or
2193 Fixed bug in scan handling in front end server: if preferred-Position-In-
2194 Response was non-present, a NULL pointer referece was performed.
2196 --- 2.1.4 2005/04/26
2198 Changed include/yaz/diagbib1.h and added include/yaz/diagsrw.h with
2199 diagnostic messages+codes for Bib-1 and SRW. Preprocessor defines are
2200 now defined for all those error codes. So instead of putting 109 in
2201 your program you'd use YAZ_BIB1_DATABASE_UNAVAILABLE. The messages
2202 are generated from a .csv - file. See src/bib1.csv and srw/srw.csv.
2204 Modified the yaz-marcdump utility to skip garbage bytes between MARC
2207 Fixed bug - uninitialized memory - due to bad code for fix of bug #272.
2209 Program yaz-client now exits and produces an error message if multiple
2210 Z39.50 servers are specified on the command line (none or one allowed
2213 Program yaz-marcdump skips garbage bytes between ISO2709 records rather
2216 --- 2.1.2 2005/03/16
2218 Fixed bug #273: Update for recent MARC-8 -> UNICODE changes.
2220 Fixed bug #272: Preserve spacing for CCL terms.
2222 --- 2.1.0 2005/03/14
2224 Added support for virtual hosts and multiple backend servers for
2225 the YAZ frontend server. The configution is XML based and
2226 support specificition of CQL to RPN mappings and explain information.
2227 See section "Virtual Hosts" in the YAZ manual.
2229 Extended OPAC display utility. OPAC display utility renders
2230 bibliographic (MARC) record as well. Added yaz_opac_decode_wrbuf
2231 to supplement yaz_marc_decode_wrbuf.
2233 Fixed a bug in MARC decoder that could caused it to crash for some
2234 invalid MARC records. More diagnostics and warnings where added in
2235 XML output (warnings, etc are stored in comments).
2237 --- 2.0.34 2005/02/08
2239 Fixes for UNIX domain sockets. Bug #261.
2241 Fixes for MARC-8 to UTF-8 conversion. Bugs #258 and #260.
2243 Fixed bug #263: YAZ MARCXML dump shows extra spaces after control fields.
2244 Added yaz_marc_subfield_str which defines subfield lead string which is
2245 used in YAZ_MARC_LINE format. Default string is blank+$. Added
2246 yaz_marc_endline_str which defines end of fields string used in
2247 YAZ_MARC_LINE format. Default string is newline.
2249 Experimental support for MarcXChange. This format can be produced
2250 by yaz-marcdump and is implemented in yaz_marc_decode - functions.
2251 http://www.bs.dk/standards/MarcXchange.xsd
2253 Added yaz-client commands scansize that sets maximum number of
2254 entries to be returned by scan.
2256 --- 2.0.32 2005/01/11
2258 Added support for SRW scan in yaz-client and Generic Frontend Server.
2260 * Added whereInList member to SRW Scan Term.
2262 * Changed Z_SRW_scanRequest to be able to carry both CCL and PQF.
2264 Fixed NMEM system to return aligned blocks on the smallest boundaries
2265 that are suitably aligned for all possible types on the particular
2266 architecture YAZ is being built for.
2268 --- 2.0.30 2005/01/04
2270 Fixed numerious warnings that was issued with newer versions of GCC.
2272 Fixed NMEM system to return aligned blocks on 8 byte boundaries rather
2273 than 4 bytes, since 4 may not be enough on some systems such as GCC 3.4.3
2276 Make YAZ Generic Frontend Server slightly faster.
2278 Enhance (and reduce) logging for Generic Frontend Server.
2280 Revert YAZ log system so that it flushes every write operation
2281 by default. (YAZ 2.0.26 and earlier verisons did that). Bug #240.
2283 Modified the YAZ logging system. The LOG level defines use YLOG_ prefix
2284 instead of LOG_, due to name clash with syslog(3). LOG_ are still
2285 present. New applications should define YAZ_USE_NEW_LOG=1 - this
2286 will effectively disable old definitions.
2288 --- 2.0.28 2004/11/09
2290 Added yaz_log_time_format which specifies log format using
2293 Added yaz_log_module_level which returns mask for a module. Value
2294 is non-zero mask a if module is enabled; zero if disabled.
2296 * Fixed bug #148: CQL parser may leak. A few prototypes were changed
2297 in include/yaz/cql.h.
2299 Fixed bug #176: Dont throw diagnostics on empty SRU args.
2301 Fixed bug #175: surrogate diagnostics in SRW lacking NS.
2303 Fixed bug #172: RPM builds does not enable SSL.
2305 Doxyfile.in part of dist. Doxyfile generated by configure.
2307 Configure aborts if any of --with-xml2, --with-openssl, --enable-tcpd
2308 are given and the corresponding component does not exist.
2310 Extend CCL documentation in YAZ reference. Describe r=r.
2312 --- 2.0.26 2004/10/01
2314 Fixed MARC->MARCXML conversion to properly deal with
2315 fields, subfields, indicators having non-ASCII characters.
2317 Fixed MARC->MARCXML conversion so that ASCII control characters
2318 except TAB,CR,LF are removed from resulting XML (XML 1.0 does not
2321 Added YAZ GFS support for conversion from Z39.50 surrogate
2322 diagnostics to SRW surrogate diagnostics.
2324 Bug fix: YAZ GFS did not return schema in explainResponse.
2326 --- 2.0.25 2004/09/30
2328 The YAZ GFS when converting SRW/SRU requests to Z39.50 structures
2329 now converts recordSchema to elementSetName as well as schema URI.
2331 Fixed bug in COMSTACK that prevented HTTP request packages from being
2334 --- 2.0.24 2004/09/29
2336 Added CCL facility r=r "range" which is similar to r=o "ordered" but
2337 does not require white-space before and after the dash in a range, e.g.
2338 x=-1990 is equivalent to x <= 1990 iff r=r, but equivalent to x= -1980
2341 Fixed a few AC_TRY_LINK configure tests that did not operate properly
2342 due to new GCC removing "redundant" code.
2344 Added yaz-client commands scanpos and scanstep that sets preferred
2345 position and step-size for scan.
2347 Macro YAZ_INIT in yaz.m4: option --with-yazconfig renamed to --with-yaz.
2349 Added CCL utility ccl_qual_buf which parses one or more CCL
2350 spec lines in a buffer.
2352 Added CCL utility ccl_qual_line which adds CCL qualifier line consisting
2353 of name and value - ignoring empty lines and comments.
2355 On Windows, the debug DLL/import lib is now named yazd.{dll,lib}.
2357 Added odr_get_element_path which returns current element path for an
2358 ODR handle. This utility is useful in error handling or user-defined
2361 Added ODR_PRINT utility odr_set_stream which is is a more generic
2362 alternative to odr_setprint. odr_set_stream takes a stream handle, pointer
2363 to a write function and pointer to close function. The close function - if
2364 non-NULL - will be called during odr_destroy.
2366 Fixed bug in CCL parser where truncation char was not removed from
2367 right side when truncation=both was in effect.
2369 Fixed CQL parser to use unsigned chars for isxxx from ctype.h due
2372 --- 2.0.23 2004/08/11
2374 Fix buffer overrun in CQL parser when dealing with proximity (%).
2376 Fixes for MARC-8 in yaz_iconv character set utilies. The MARC-8
2377 to UTF-8/UCS conversion is now only based on codetables.xml.
2379 yaz_marc_decode_buf sets leader pos 9 to "a" for MARCXML output.
2381 --- 2.0.22 2004/08/06
2383 Add support for more "commit changes" in ZOOM (uses Extended Services).
2385 For yaz-client, command set_marcdump <file> / -m <file> dumps SUTRS/XML/..
2388 Yet another small fix for configure of SSL.
2390 --- 2.0.21 2004/05/14
2392 Fix SSL libs for configure when --with-openssl=DIR is given.
2394 --- 2.0.20 2004/05/10
2396 Add autoconf m4 macro YAZ_DOC for YAZ documentation setup (docbook).
2398 SSL comstack now uses yaz.pem certificate file on server side
2399 by default. Certificate filename can be configured by calling
2400 comstack function cs_set_ssl_certificate_file before cs_bind is used.
2402 Fix bug regarding multiple calls to ZOOM_connection_connect.
2404 Implement cs_set_ssl_ctx which sets SSL_CTX for SSL comstack.
2406 Do not create SSL_CTX in cs_create (ssl_type). Create in tcpip_bind,
2407 tcpip_rcvconnect instead. This allows user to set custom SSL_CTX.
2409 ZOOM now allows inspection of X509 peer certificate for verification.
2410 The X509 buffer is retrived by reading ZOOM option "sslPeerCert".
2412 Removed libyazssl.la. When SSL is enabled, libyaz.la has SSL support and
2413 all programs have too (yaz-ztest, yaz-client, zoom..). May not be
2414 as "modular" but it simplifies things.
2416 Added cs_get_peer_certificate to that returns peer X509 PEM.
2418 Added cs_get_ssl that returns SSL handle (SSL *) for SSL comstack; returns
2419 NULL if SSL is unavailable.
2421 Documentation about MARC decoding tools.
2423 Fix --disable-tcpd to really disable tcpd. Patch by Robin H. Johnson.
2425 --- 2.0.19 2004/03/30
2427 Rename CHANGELOG to NEWS to follow GNU style packing.
2429 Fix bug with missing initialization of member in init_diagnostics.
2430 This bug affects threaded version of GFS server.
2432 --- 2.0.18 2004/03/20
2434 Use wrbuf_xmlputs_n instead of wrbuf_write_cdata to avoid clash with
2437 Ensure zlib.dll is packed with Windows install.
2439 --- 2.0.17 2004/03/17
2441 Fix encoding of xsd:string to use text instead of CDATA.
2443 Fix endless loop in CQL parser with unbalanced ".
2445 Use a more compact way to store MARC-8 conversion tables.
2447 --- 2.0.16 2004/03/16 Debian only
2449 Oleg Kolobov Fixed a bug in yaz_iconv regarding conversion to
2452 Update CQL parser to use new CQL 1.1 modifiers for booleans and
2457 --- 2.0.15 2004/03/01
2459 Another fix for decoding of XML packed records.
2461 --- 2.0.14 2004/02/25
2463 Fixes for Chunked encoding. White space not ignored after length spec.
2465 Update NS and use default NS for SRW diagnostic elements.
2467 --- 2.0.13 2004/02/23
2469 Implement ZOOM_resultset_cache_reset which resets record cache.
2471 Implement ZOOM_resultset_sort which sorts a result set.
2473 Implement chunked HTTP transfer.
2475 For SSL, use -lssl -lcrypto on systems that don't have pkg-config.
2477 --- 2.0.12 2004/02/16
2479 Added member 'schema' to bend_explain_rr structure so that backend
2480 can specify explain record identifier. Defaults to Zeerex 2.0.
2482 Fix encoding of OID's of form 1.0.X. Bug introduced in 2.0.11.
2484 --- 2.0.11 2004/02/16
2486 * SRW/SRU 1.1 updates: updated diagnostic in srw.h to use uri instead
2489 Added init command for yaz-client which sends "extra" init request.
2491 Fixed two bugs in OID codec - ber_oidc. Throw error when encoding/decoding
2492 bad truncated OID. Fix decoding of OID X.Y... when X=2 and Y>39.
2494 Fixed a bug in ASN.1 compiler that caused Type-1 Operator codec to fail.
2496 Make ZOOM error code for "invalid query".
2498 Fixed compilation for SSL which wasn't properly enabled for all platforms.
2500 --- 2.0.10 2004/02/05
2502 For yaz.m4, allow second argument for YAZ_INIT to hold minimal version of
2505 * SRW/SRU 1.1 updates. Diagnostic code now a URI.
2507 Added option -p <file> to make Generic Frontend Server to write PID file.
2509 Added option -D to put Generic Frontend Server in background on its own.
2511 Make ZOOM C recognize option "password". If unset, "pass" is used
2512 (for backwards compatibility).
2514 Fixed a bug in Generic Frontend Server that could make it crash if a
2515 client sets characterSetNegotation bit, but didn't pass negotiation stuff
2518 New YAZ client command, zversion, that sets Z39.50 version (1,2,3..).
2519 Must be issued before open, in order to be in effect.
2521 --- 2.0.9-6 2004/01/12 Debian/Windows
2523 Make the SRU server more picky WRT unknown params, etc.
2525 Bug fix: ZOOM scan response didn't return displayTerm - when present.
2527 New YAZ client command, options, that sets Z39.50 options.
2529 New utility functions yaz_init_opt_{encode,decode} to encode/decode Z39.50
2530 options from a string of tokens (one token for each option bit).
2532 Update SRW diagnostic code messages.
2534 --- 2.0.9-5 2004/01/07 Debian/Windows
2536 Handle user defined stylesheet for SRW/SRU.
2538 --- 2.0.9-4 2004/01/06 Debian/Windows
2540 Fix bug in decoding of Content-Length.
2542 --- 2.0.9-3 2004/01/06 Debian/Windows
2544 Fix a bug with decoding of XML packed records.
2546 --- 2.0.9-2 2004/01/05 Debian only
2548 Allow empty ODR (NMEM=0) for odr_oiddup and odr_getoidbystr.
2550 Fix bug in SRW/SRU diagnostics decoding.
2552 --- 2.0.9 2004/01/05
2554 Fixed bug in Generic Frontend Server which could drop records exceeding
2555 preferred message size. Reported and fixed by Irina Dijour.
2557 Fixed calculation of package size for structured records in Generic
2558 Frontend Server. Reported and fixed by Irina Dijour.
2560 Fixed namespace for SRW/SRU diagnostics.
2562 Fixed SEGV in yaz-client that occured for HTTP connection errors.
2564 --- 2.0.8 2003/12/22
2566 * SRW/SRU 1.1. Since the Namespace has changed for SRW/SRU, it means that
2567 this version is incompatible with version 1.0 and older YAZ SRW/SRU
2570 CQL changes to reflect recent changes to the specification:
2571 * Documentation talks about context sets instead of index sets.
2572 * Documentation talks about indexes instead of qualifiers.
2573 * The CQL-to-PQF transformer's configuration file now uses
2574 "index.set.name = <attributes>" instead of the old form
2575 "qualifier.set.name = <attributes>". (Both forms are still
2576 understood but the latter is deprecated.)
2577 * CQL terms with no explicit index specified are now interpreted as
2578 cql.serverChoice instead of srw.serverChoice (which of course
2579 behaves exactly the same.)
2581 --- 2.0.7 2003/12/16
2583 MARC conversion can now generate ISO2709 output in another
2584 character set. yaz-marcdump uses this facility if you invoke it
2587 Added missing C decl macros for include/yaz/{soap.h,srw.h,cql.h}, so that
2588 functions from there can be used from C++.
2590 --- 2.0.6 2003/12/04
2592 Frontend server now transfers memory from decoded packages to stream
2595 NMEM now clears freed blocks with 'Y' (hex 59) to force bad memory
2596 references to show up.
2598 ZOOM-C now supports standard ZOOM option names as described in v1.4 of
2599 the ZOOM Abstract API. The older names for the same options are still
2600 also supported for the benefit of old applications.
2602 ZOOM-C supports "implementationId" and "implementationVersion" options
2603 to go along with "implementationName". These allow the user code to
2604 specify identification strings to be sent to servers.
2605 Add OID for the new ExtLite attribute set.
2607 Add OIDs for NACSIS-CATP, FINMARC2000 and MARC21-fin record-syntaxes,
2608 as requested/supplid by Ere Maijala <ere@atp.fi>
2610 For generic frontend server, reverse the order of
2611 "toolkit-supplied / application-supplied" strings sent as implementationId,
2612 Name and Version. Also, remove the spaces around the slash. This brings
2613 the GFS in line with the behaviour of ZOOM-C on the client side.
2615 Add function ZOOM_scanset_display_term.
2617 yaz-client shows scan displayTerm if present.
2619 Utility yaz-iconv is now installed by default along with the man page
2622 Extend configure check for OpenSSL to use pkg-config where available (such
2625 Incorporate patch by Morten Bogeskov which allows a Unix file socket
2626 server to specify uid/gid/mask for socket using the format
2627 unix:[user=uid,][group=gid,][umask=mask,]file=path
2628 If file= is omitted the existing format is assumed, e.g.
2630 in which case the mask is 0666 (rw for everybody).
2632 Major restructure of YAZ source. All source in libyaz is in src directory.
2633 Programs in client (yaz-client), ztest (yaz-ztest), zoom (zoom programs),
2634 util (utility programs such as ASN.1 compiler, yaz-marcdump).
2636 Added man page for utility yaz-marcdump (used to be called marcdump).
2637 yaz-marcdump is installed by 'make install'.
2639 Fixed a memory leak in Generic Frontend Server that occurred when decoding
2640 of incoming package failed.
2642 Fixed a potential DOS attack vulnerability in COMSTACK/ODR.
2644 Change prototype of odr_perror: add const to message string.
2646 New function yaz_log_reopen which reopens log file (for log rotate, etc.)
2648 * Blocking parameter for COMSTACK cs_create is now a bit mask rather
2649 than a blocking flag. Bit 0 is set for blocking, reset for non-blocking.
2650 Bit 1 is set if cs_addrstr should avoid DNS lookup; reset for full
2651 DNS lookup. There should not be any compatibility problems with this
2652 assuming that blocking=1 or 0 is used.
2654 Fix bad reference in UNIX comstack in function cs_addrstr.
2656 Fix for compilation on AIX.
2658 The generic front-end server (server/seshigh.c) now supports returning
2659 Init diagnostics to the client in User-information-field, in
2660 accordance with Z35.90 Implementor Agreement 5 (Returning diagnostics
2663 --- 2.0.4 2003/09/04
2665 Allow any CQL relation (not just all,any,exact,scr).
2667 Fixes for OCLC UI ASN.1 to make it work with SilverPlatter targets
2668 that features the same UI.
2670 Implemented command update0 in YAZ client which is equivalent to
2671 update but uses old of Ext Update ASN.1.
2673 Use OID 1.2.840.10003.15.1000.81.1 for privately defined charsets
2674 in charset negotiation. Added VAL_ID_CHARSET in oid.h.
2675 Previously no OID was used for this info.
2677 ZOOM uses smallSetUpperBound=1 instead of 0 for piggyback searches.
2678 It apparantely upsets EBSCO Publishing IR Z39.50 Server which
2679 returns 'malformed search term' otherwise.
2681 SortResponse member resultCount now set to NULL in sort handler of
2684 OPAC support ZOOM. ZOOM_record_get returns OPAC info (as XML) if
2687 Add three new utility functions for translating OIDs between various
2688 formats -- symbolic name such as "Usmarc", minus-1-terminated int
2689 arrays and dotted strings such as "1.2.840.10003.9.5.1":
2690 int *oid_name_to_oid(oid_class oclass, const char *name, int *oid);
2691 char *oid_to_dotstring(const int *oid, char *oidbuf);
2692 char *oid_name_to_dotstring(oid_class oclass, const char *name, char *oidbuf);
2694 Reverted modifications for ES Update definition for z_IU0Update
2695 (OID 1.2.840.10003.9.5.1 and 1.2.840.10003.9.5). The definition
2696 is back to YAZ 2.0.2.
2698 String value attributes for CCL parser.
2700 Support for OCLC's locally registered "OCLC-UserInformation" PDU,
2701 which their FirstSearch server returns in Init responses, sometimes
2702 carrying useful diagnostic information when Init fails. This has the
2703 OID 1.2.840.10003.10.1000.17.1 and is defined in the file
2704 "z39.50/oclcui.asn", where its definition is somewhat different from
2705 what OCLC document on their web-site, as required to interoperate with
2708 Support for anonymous authentication in yaz-client. Use the command
2711 * Fix the OID of the Index Data-local "admin" Extended Service from
2712 1.2.840.10003.9.81.1 to 1.2.840.10003.9.1000.81.1. The omission of
2713 the 1000, which indicates a locally-defined OID, was a mistake.
2715 --- 2.0.3 2003/06/20
2717 Fix CCL directive @case handling so that it affects string match for
2718 both CCL keywords and qualifiers.
2720 * ESFormat-Update updates. Packages with OID 1.2.840.10003.9.5.1 and
2721 1.2.840.10003.9.5 are now handled by the same decoder z_IU0Update .
2722 Decoder has been updated with ASN.1 changes as listed in
2723 http://lcweb.loc.gov/z3950/agency/defns/updateES.html
2724 Note that the "latest" DB Update, OID 1.2.840.10003.9.5.1.1 , handler
2725 z_IUUpdate, remains unchanged.
2727 ZOOM_record_get may now return a record in a specific character set.
2728 For type use "form; charset=from[,to]" where form (render, xml, ..) ,
2729 "from" is the character set of record as returned by target. "to" is
2730 the character set to be returned. If omitted, "to" is UTF-8.
2732 YAZ ASN.1 compiler renamed from yaz-comp to yaz-asncomp
2734 New ODR utility, odr_getelement, which returns name of element for
2735 which encoding/decoding failed.
2737 Fixed ODR so that it returns error code OREQUIRED rather than ONONE
2738 in cases where a required element was omitted.
2740 Bug fix: some MARC8 sequences were not converted.
2742 New ZOOM option "step" which specifies number of records to be
2743 retrieved in one chunk. Used in conjunction with "start" and "count".
2745 SRW support for yaz-client. Use scheme http: to use it, e.g.
2748 yaz-client no longer does (un)intelligent character set conversions
2749 by default. Can be enabled with charset and marc_charset commands.
2751 xmalloc trace fix for 64-bit systems such as DEC alpha.
2753 Solaris 2.6 compile fix.
2755 New function, cql_strerror() translates SRW error codes, as returned
2756 by cql_transform_error(), into human-readable English strings. Used
2757 in yaz-client diagnostics when appropriate.
2759 New CQL2RPN query-type for the command-line yaz-client, parses CQL and
2760 converts it into a type-1 query which is sent to the server. This
2761 makes CQL available for use with all Z-servers, as opposed to the tiny
2762 minority that can handle CQL queries themselves.
2764 --- 2.0.2 2003/04/28
2766 New Debian package layout similar to the Redhat Package layout.
2768 New ZOOM events ZOOM_EVENT_RECV_{RECORD,SEARCH} for receiving a record
2769 and search result respectively.
2771 --- 2.0.1 2003/04/25
2773 Redhat package is now several packages: libyaz (runtime libraries),
2774 libyaz-devel (development and documentation, and yaz (utility programs).
2775 Package spec file by Morten Bogeskov.
2777 New member 'schema' in struct bend_fetch_rr which the name of requested
2778 schema (SRW/SRU) for record (or NULL if none was given). The fetch
2779 handler MAY set this to reflect the schema of the returned record.
2781 New member 'display_term' in struct scan_entry. GFS now sets member entries
2782 and allocates scan entries to be filled by user scan handler. In previous
2783 version, entries member was allocated by the scan handler. That still works,
2784 but the GFS will ignore member display_term - assuming it was NOT set by
2785 the handler. The fact that the GFS now allocates the entries both allows
2786 for new members and makes a scan handler easier to write.
2788 Fix CQL lex buffer overflow.
2790 SRW/SRU recordPacking. For SRW default recordPacking is string. For
2791 SRU default recordPacking is string.
2793 SRU protocol support for frontend server.
2795 Fix compile bug for systems that have nl_langinfo but CODESET undefined.
2797 Added missing PQF transform rules for <= and >= . Thanks to Peter Popovics.
2799 Added scan for the ZOOM shell (zoomsh).
2803 * String Identifers for Schemas (Amendment 5).
2804 http://lcweb.loc.gov/z3950/agency/amend/am5.html
2805 Old definition for schema
2806 Odr_oid *schema; /* OPT */
2811 Z_InternationalString *uri;
2812 #define Z_Schema_oid 1
2813 #define Z_Schema_uri 2
2816 * resultCount parameter to Sort Response (Amendment 1).
2817 http://lcweb.loc.gov/z3950/agency/amend/am1.html
2819 Support for SRW 1.0 over HTTP. This is an optional feature and
2820 requires libxml2 to operate. Enable SOAP by specifying --with-xml2
2823 Generic frontend server supports HTTP/SOAP/SRW and Z39.50/BER
2824 on the same port. SRW SearchRetrieveRequests are mapped
2825 to bend_init,bend_search,bend_fetch,bend_close.
2827 Z39.50 Query Type-104 added - to facilitate CQL within Z39.50.
2829 CQL support. Source is directory 'cql'. CQL is supported in ZOOM
2830 (both SRW and Z39.50) and the YAZ client (Z39.50 only).
2832 ZOOM connections are SRW based if schem http is used for hostname
2833 in connect, e.g. z = ZOOM_connection_new("http://myserver");
2834 ZOOM_query may be of type CQL, e.g. ZOOM_query_cql(q, "dc.title=x");
2836 CCL proximity operators !n, %n converts to PQF @prox 0 n 1 2 k 2
2837 and @prox 0 n 0 1 k 2 respectively, meaning: exlusion=false,
2838 distance=n, order=true/false, relation=le, prox unit=word. If
2839 n is omitted, distance 1 is used.
2841 Fixed problem with C compiler include path in wrong order.
2843 For TCP/IP COMSTACK, set recv buffer to an appropriate "large" value
2844 on Solaris. Patch from Ko van der Sloot.
2846 New MARC decode API. All new functions operate on a yaz_marc_t
2847 handle. The most important new functions are: yaz_marc_create,
2848 yaz_marc_decode_{buf,wrbuf}, yaz_marc_destroy, .. to create handler,
2849 decode and destroy respectively. Decoder can produce formats
2850 MARC line, simple XML, OAI MARC and MARC XML (LoC). See
2851 include/yaz/marcdisp.h.
2853 YAZ Iconv utility now supports MARC8 decoding (marc8.c). Converts
2854 to UTF-8, UCS-32, wchar_t or Latin-1.
2856 * Prototypes for yaz_iconv_-functions moved to separate header
2857 include/yaz/yaz-iconv.h.
2859 Make a few private functions 'static' in unix.c. This prevents
2860 duplicate unix_close in PHP with YAZ and imap. PHP Bug 20977.
2862 For ZOOM connection, the options targetImplementation{Id,Name,Version}
2863 are set when Init Response is received.
2865 New function ZOOM_connection_error_x similar to ZOOM_connection_error
2866 but returns diagnostic set as well.
2868 New function yaz_strerror which is a portable wrapper for
2869 strerror/strerror_r/GetLastMessage.
2871 * ZOOM_record_get supports type "xml" in which case MARC XML (from LOC)
2872 is returned for MARC. If type is "oai", then OAI MARC is returned.
2874 Fix creation of lib/yaz-config so it works if srcdir != objdir. Patch
2877 --- 1.9.2 2002/11/26
2879 yaz_marc_decode uses OAI MARC as XML format for ISO2709 records.
2881 Fix bad race conditions on SIGTERM and terminate gracefully in
2884 Move retrieval (data1) module to Zebra since nobody seems to be
2887 Add GRS-1 render for ZOOM using same format as yaz-client.
2889 --- 1.9.1 2002/10/05
2891 Added man pages: yaz-client(1), yaz-ztest(8), yaz(7), zoomsh(1).
2893 Fix broken ESpec handling in data1 module.
2895 SGML reader parses comments and makes them part of the data1 tree.
2897 Added several type casts so that YAZ compiles as C++ code.
2899 ZOOM didn't handle PDU encoding failures properly.
2901 Added more Bib-1 diagnostics (approved extensions).
2903 GNU configure: better check for iconv.
2905 More portable use of accept, getpeername. Check for socklen_t. Use
2906 int/size_t if socklen_t is not defined.
2910 PQF parser rejects bad queries - including those with extra
2911 characters in them. PQF parser used to silently ignore that.
2912 Cleaner API for PQF added, which allows you to get detailed
2913 error information for bad queries (see yaz/pquery.h).
2915 Fixed bug in ZOOM_record_get for type "database".
2917 Implemented mini iconv library supporting conversions between
2918 UTF-8, UCS4, UCS4LE and ISO-8859-1. Implemented in util/siconv.c.
2920 * Removed XML reader (d1_expat.c). It's part of Zebra instead.
2922 --- 1.8.9 2002/08/20
2924 Fixed ZOOM C record cache so that preferredRecordSyntax and
2925 elementSetName is used to check for already fetched records.
2927 --- 1.8.8 2002/08/02
2929 Added three members in bend_initrequest structure to facilitate
2930 character set negotiation.
2932 Fixed a bug in frontend server that could cause indefinite
2933 loops under rare conditions.
2935 Revised character set utilities (charneg.h) so that encoding
2936 UCS-4, UCSA-4, UTF-16 and UTF-8 are encoded non-privately.
2938 For PQF, directive @term <type> sets term type for Scan/Search.
2939 Here <type> is general, string, numeric, null. The term type
2940 is inherited - just like @attr.
2942 New call odr_set_charset that sets character set conversion for
2943 international-strings on a ODR stream. Prototype is:
2944 int odr_set_charset(ODR o, const char *to, const char *from);
2945 The InternationalString is still represented as C string in YAZ
2946 so native strings of type UTF-8, ASCII, etc. will work (UTF-16
2947 won't). On the protocol level, you can use any encoding.
2949 Support for UNIX sockets in ZOOM.
2951 Solaris recv sometimes returns errno == ENOENT. It is treated as
2952 EINPROGRESS. COMSTACK patch by Ko van der Sloot.
2954 New COMSTACK of type UNIX Socket. Use "unix:/path" as address for
2955 both client and server. Code by Morten Bogeskov.
2957 --- 1.8.7 2002/05/22
2959 On Windows ZOOM functions are of type __stdcall rather than __cdecl, so
2960 that they can be used directly from Visual Basic. You must recompile
2961 your windows APP if you're using ZOOM.
2963 Character Set and Language Negotiation(3) for ZOOM API and YAZ client.
2964 Commands "lang" and "charset" sets language and character set respectively.
2965 Options "lang" and "charset" is interpreted by the ZOOM API. Note, these
2966 are not part of the official ZOOM spec) All is due to Oleg Kolobov.
2968 Attributes from multiple CCL fields may be OR'ed rather than merged
2969 using directive "@field or". Fields are still merged by default -
2970 equivalent to "@field merge".
2972 Fixed bug in ZOOM connect that occurred on OpenBSD (maybe others). Patch
2975 Fixed bug in zget for parameter ExtendedServicesResponse.
2979 --- 1.8.6 2002/03/25
2981 Added PQF feature: '@attr type=value' may be written as '@type=value'.
2983 Client displays USR.1:SearchResult-1 (hits per term).
2985 Additional Search Info for search in Generic Frontend Server.
2987 Fixed CCL parsing of "field=s".
2989 WIN32 installer - using the excellent NSIS software from nullsoft.
2991 Fixed CCL parsing of "field = - <number>".
2993 Added function yaz_marc_decode that decodes MARC for line mode
2994 display or XML (similar to that used by JZKit).
2996 Fixed BER decoding of OPTIONAL CHOICE. The bug didn't affect the
2997 Z39.50. But ISO/ILL was, however.
2999 Added patch by Rustam T. Usmanov that implements Z39.50 duplicate
3000 detection service (Z39.50-1995 Amendment 2) and Language Negotiation (3).
3002 http://lcweb.loc.gov/z3950/agency/amend/am2.html
3003 http://lcweb.loc.gov/z3950/agency/defns/charneg-3.html
3005 --- 1.8.5 2002/02/03
3007 New YAZ client features: Command completion and new commands:
3008 push_command, set_apdufile, set_marcdump, set_cclfields, register_oid.
3009 Code provided by Jacob Poulsen.
3011 New call oid_trav, that visits all registered OIDs via callback.
3013 Function ZOOM_record_get now returns const char pointer rather than
3014 void pointer. It saves a lot of type casts.
3016 For YAZ client, command "auth" now allows you to set authentication
3017 in IdPass style. It is enabled when three tokens are given - order
3018 is user, group and password.
3020 Fix memory leaks in MARC record handling for ZOOM.
3022 New option for YAZ client, -k <kilobytes> that sets
3023 maximum record size. Similar to -k option for generic frontend
3024 server and yaz-ztest.
3026 More fixes for scan. Non-zero stepSize handled. OID's fixes.
3028 Prefix query parser reports "fail" when bad attribute set is given.
3030 Fix in MARC decoder. Proximity logging. Fix for attribute set
3031 in scan handler for server. Patches by Shigeru Ishida.
3033 SSL/COMSTACK updates. cs_rcvconnect completes SSL handshake. ZOOM
3036 Configure option --with-openssl=<dir> now works when a directory is
3037 specified. Patch provided by Morten Bogeskov.
3039 New option for YAZ client, -u <auth>, that sets authentication.
3041 ZOOM fix: error information was sometimes "missing", since error
3042 was cleared/reset too when it shouldn't.
3044 ZOOM_record_get returns ISO2709 buffer when "raw" is given.
3046 --- 1.8.4 2002/01/04
3048 Scan for ZOOM API. New object ZOOM_scanset. New functions
3049 ZOOM_connection_scan, ZOOM_scanset_size, ZOOM_scanset_term and
3050 ZOOM_scanset_destroy.
3052 New ZOOM function, ZOOM_connection_last_event, that returns type
3053 of last event (such as "receive data", "send data", "apdu received",
3056 New ZOOM option, schema, that specifies schema for retrieval.
3058 New CCL feature. Qualifiers can be aliases for one or more
3059 other qualifiers (if more than one is given, OR is used).
3061 ZOOM uses named result sets if target supports it.
3063 Two new YAZ client commands: . (dot, which sources a script of YAZ
3064 client commands), and ! (to execute shell command.). Implemented
3067 Working on Debian packages.
3069 --- 1.8.3 2001/11/19
3071 YAZ client enables named result sets only if target supports it.
3073 *** ZOOM. Prefix for ZOOM definitions changed from Z3950_ to ZOOM_.
3075 * ZOOM. Removed Z3950_connection_host. Use Z3950_connection_option_get
3076 with key="host" to get same result.
3078 * ZOOM. Added Z3950_record_clone and removed Z3950_resultset_get.
3079 Function Z3950_resultset_record(s) returns references to records
3080 "owned" by resultset. To become owner use Z3950_record_clone.
3082 Function z_ext_record handles Extended Services. Thanks to
3085 --- 1.8.2 2001/11/12
3087 CCL Parser fix: ignore token comma when dealing with and-lists.
3089 Documentation updates for COMSTACK.
3091 * ZOOM changes. Query object renamed from Z3950_search to Z3950_query.
3092 Changed prototype Z3950_records. For some functions, int parameters
3093 were changed to size_t.
3095 TCP/IP COMSTACK no longer uses getprotobyname to avoid memory leak
3098 New MARC decode/display function, marc_display_exl, which properly rejects
3099 non-ISO2709 records. YAZ client uses it.
3101 --- 1.8.1 2001/10/29
3103 Fix bug: local attribute set wasn't set correctly in PQF strings.
3107 * Old Z39.50 codecs no longer supported.
3109 Added ZOOM C binding. See http://zoom.z3950.org/
3111 Renamed states for COMSTACKs to avoid confusion with events.
3113 Implemented cs_look and proper cs_rcvconnect.
3115 Fixed COMSTACK error that occurred on HPUX. Fix by Giannis Kosmas.
3117 Configure detects POSIX threads on OpenBSD.
3119 When sort flag 'i' was specified in yaz-client the caseSensitivy flag
3120 was set to a wrong value. Thanks to Robert Sanderson for reporting this.
3122 When error is returned from present handler, non-surrogate diagnostic
3123 is returned in present response (and fetch handler is no longer called).
3125 * Minor adjustments to pquery parser (PQF). Token characters may be
3126 escaped by using backslash (C-style).
3128 PQF parser allows string attribute values to be specified. For @attr,
3129 non-numeric characters after the equal-sign are treated as strings
3130 (e.g. @attr 9=title).
3132 CCL trunction character may be defined (@truncation in file)
3134 * function zget_ExtendedServicesRequest sets waitAction to
3135 waitIfPossible (was wait).
3137 Added cs_set_blocking to set change blocking mode of a COMSTACK. Thanks
3140 CCL operator names may be set in field definition files (CCL_bibset).
3141 See ccl/bib1 for an example.
3143 Fixes in ASN.1 compiler for C++ compatibility.
3145 * Renamed members "and" and "or" in struct Z_Operator to "op_and"
3146 and "op_or" to avoid conflict with C++.
3148 Fixed problem with GNU readline detection on Redhat 7.0.
3150 Added step-size for Scan backend handler.
3152 Fixed bug that made the frontend server crash when no attribute
3153 set was specified for scan.
3155 Front-end server automatically switches to original working directory
3156 when installed as an NT service. Previously -w had to be specified to
3159 Added extended attributes for retrieval module (data1), so that data1
3160 records carry d1_readXML/SGML attributes. d1_read also supports
3161 null-data rules ( <tag/>)
3163 On UNIX when POSIX threads are available, a separate library libyazthread
3164 is created. Programmers should link with that library and the yaz library
3165 when using threads. The reason for the split was that some applications
3166 on Linux, such as Apache, doesn't work well when using shared objects that
3169 Added SSL support for the COMSTACK. You start yaz-client and yaz-ztest
3170 (or any frontend server) in SSL mode by specifying ssl: followed by
3171 address. Only tested on UNIX.
3173 Added feature for CCL module. Virtual structure s=al or s=ol generates
3174 and-list and or-list respectively instead of phrase search.
3178 * Added prefix "yaz_" for the functions log_init.., log_file.. and
3179 log_mask_str. This was done to avoid name conflicts with other libraries
3180 (such as other PHP extensions).
3182 Added raw OID member for preferred record syntax (request_format_raw)
3183 and returned record syntax (output_format_raw) for backend fetch method.
3185 Config file yaz-config now accepts options so that it returns specific
3186 compile settings, etc. Thanks to Morten Bogeskov <morten@bogeskov.dk>
3188 Shared library support for UNIX using GNU libtool.
3190 * Modified backend interface. Request/Response struct's replaced by
3191 one read/write C struct. For example bend_fetchrequest and
3192 bend_fetchresult have been replaced by single bend_fetch_rr struct.
3193 Every handler - even search has to be registered in bend_init
3194 handler. This means that the YAZ library no longer refers to
3195 external functions and it makes it possible to make the whole
3196 thing a single DLL/SO.
3198 Added Segment handler for backend server.
3200 Added Zmbol/Zebra administrative functions to YAZ client.
3202 Threaded frontend server on UNIX (when POSIX Threads are available).
3203 Starting the server with option -T enables multi-threading.
3207 Added configure option --enable-comp/disable-comp to control use
3208 of YAZ ASN.1 compiler. Use --disable-comp to use the old *coders
3209 located in sub directory asn.
3211 YAZ ASN.1 compiler renamed to yaz-comp in sub directory. It's installed
3212 in ${exec_prefix}/bin along with the other programs yaz-client and
3215 GNU automake used to maintain makefiles.
3217 Added several OID's.
3219 Changed retrieval module so that we can load records with no abstract
3220 syntax defined. Tagpaths in these records are fully composed of string
3223 Implemented ISO ILL protocol. Refer to stuff in sub directory ill.
3227 On UNIX, the generated makefile now supports a proper 'make install'.
3228 The prefix can be set via GNU configure to set the install location
3229 (default is /usr/local).
3231 * YAZ programs client and ztest were renamed to yaz-client and
3232 yaz-ztest to avoid conflicts when users install YAZ in "standard"
3233 locations, such as /usr/bin,/usr/local/bin,etc.
3235 * YAZ Header files were moved from include to include/yaz. YAZ Header
3236 files are referred to as include <yaz/log.h> rather than <log.h>.
3237 The YAZ include path (-I ..) is therefore the same as before. Programmers
3238 should update their #include statements or use -Ipath/include/yaz
3239 instead. The main motivation for doing this change is that YAZ header files
3240 can be installed in "standard" locations /usr/include,/usr/local/include
3241 without introducing conflicts, since ALL YAZ header files are stored
3242 in subdirectory yaz (under /usr/include for example).
3244 Compilation of YAZ for WIN32 is now handled by an nmake-style makefile
3245 rather than project/workspace files. We switched because project files
3246 are incompatible between Visual C++ 5 and 6. Refer to windows.txt for
3249 Changed name of logging function, logf, to yaz_log, to prevent name
3250 clash with some math-log functions. The YAZ header log.h defines logf
3251 to yaz_log (#define) so there should be no incompatibilities by this
3254 Added bend_start/bend_stop handlers for server. These handler are
3255 called on start/stop of server. For windows they are called whenever
3256 a service is started/stopped.
3258 * YAZ now auto-generates decoders/encoders for the Z39.50 protocol using
3259 a fairly small ASN.1 compiler written in Tcl. The compiler is located
3260 in util/yc.tcl. The auto-generated C code structures are, in a few
3261 cases, incompatible with the old decoders. There are differences in the
3262 following C structures Z_DiagRec, Z_External, Z_SortRequest, Z_SortResponse,
3263 Z_AttributesPlusTerm, Z_ProximityOperator, Z_DefaultDiagFormat.
3264 The preprocessor variable ASN_COMPILED is defined when the compiled
3265 ASN.1 is being used. Encoder/decoder routines as well as the Z39.50
3266 protocol ASN.1 is located sub directory <tt>z39.50</tt>. If you
3267 wish to use the old encoders/decoders you can specify --disable-yc
3270 Assigned OID for old DB Update (VAL_DBUPDATE0). Updated YAZ compiled
3271 version so that it supports both new - and old version of DB Update
3273 * Added 'name' parameter to ODR encoder/decoder routines to facilitate
3274 pretty ODR print. Updated whole Z39.50 encoder/decoder to reflect the
3275 change. The name parameter can be set to 0 in which no name is specified
3276 for the construction. The macros odr_implicit and odr_explicit sets name
3277 parameter to zero for the construction involved. New macros
3278 odr_implicit_tag and odr_explicit_tag are similar to the others,
3279 except that a name parameter is added. For programmers' that don't use
3280 ODR they probably only need to change the call to z_APDU and z_External.
3282 Added access control facility by interfacing the TCP wrapper library.
3283 YAZ automatically attempts to find the TCP wrapper Library (-lwrap) and
3284 tcpd.h on Unix systems. For the server, option -d<daemon> specifies the
3285 name of the daemon and enables the access control as specified in
3286 hosts.allow/hosts.deny. Refer to man pages tcpd(8) and hosts_access(5).
3288 Fixed memory leak in ccl_find_str and ccl_qual_rm. Thanks to Hans van
3289 den Dool <H.M.vdnDool@kub.nl>.
3291 Added reference ID parameter to most functions in server API - refer
3292 to backend.h. Thanks to Hans van den Dool <H.M.vdnDool@kub.nl>.
3294 Changed name of ccl library to libccl.a (was ccl.a).
3296 Fixed bug in decoder for Explain (Category TargetInfo).
3298 Added support for GNU readline in client. Thanks to Jacob Poulsen
3299 <ja7@dbc.dk>. GNU configure attempts to detect if readline is available.
3301 * CHANGED DEFINITION OF ES: UPDATE (INCLUDING THE OID) to reflect the
3302 new definition from the ZIG. NOTE THIS IF YOU HAVE AN UPDATE
3303 IMPLEMENTATION! This change was made to the development version before
3304 the ZIG decided to retract the amendment. If any users MUST be
3305 compatible with the original Update definition, PLEASE CONTACT US, and
3306 we will include a separate definition corresponding to the old Update
3307 ES. Note that because of the change to the ASN.1 of the
3308 TaskPackageRecordStructure we cannot define a single structure that
3309 will support both versions.
3311 * Added const modifier to buffer parameter for some ODR/BER encoding
3312 routines: ber_dectag, ber_declen, odp_more_chunks, completeBER,
3313 completeWAIS, odr_dumpBER.
3315 Fixed bug in client.c which caused a crash when a scanResponse didn't
3316 contain positionOfTerm.
3318 * Fixed inconsistency in the ScanResponse/ListEntries protocol. This
3319 * will cause an error in a client if a non-YAZ target sends both a
3320 * list of Scan entries and non-surrogate diagnostics.
3322 Retrieval module enhancements. Tag sets may be typed in the reference
3323 to it. From the .abs-file the "tagset" directive takes a third optional
3324 integer type for the tag set referenced. From a .tag-file the "include"
3325 directive takes a third optional type as well. The old "type" directive
3326 in the tag set itself is still recognized but acts as the default type
3329 Backend interface change. Individual Scan terms returned from bend_scan
3330 may also be tagged as Surrogate Diagnostics. Refer to struct scan_entry
3331 in include/backend.h.
3333 Retrieval module enhancements. Multiple tag sets and attribute sets may
3334 be specified in abstract syntax specs. Revised the error/warning for
3335 logging messages reported by the retrieval module when reading the
3338 Object Identifier system (oid_..) changed. The API is backwards
3339 compatible but the oid-routines now allocates new OID's when needed.
3340 Raw OID's may be specified in oid_getvalbyname.
3342 YAZ now uses GNU configure to generate Makefile(s).
3344 * Minor changes in some of the member names of DeleteResultSetRequest and
3345 DeleteResultSetResponse. See include/proto.h.
3347 * Changed some C definitions regarding EXPLAIN record syntax (prt-exp.h)
3348 and added member 'languages' in TargetInfo (which was missing).
3350 Changed the way attribute sets are handled in the retrieval
3351 module. These are now cached, just like the abstract syntaxes
3354 Changed YAZ so that it links with compiled ASN.1.
3356 Added Explain-schema definitions and mapping routines. The following
3357 Explain categories have been implemented: AttributeDetails,
3358 AttributeSetInfo, DatabaseInfo, CategoryList and TargetInfo.
3360 Fixed minor bug in Windows version of Server Library.
3362 --- 1.4pl2+ 1998/4/17 (Released with Zebra)
3364 Added Extended Services to server (backend.h). Thanks to Charles Woodfield.
3366 Added EXTERNAL: UNIverse Resource Report (non-standard).
3368 Implemened odr_enum and odr_set_of functions to handle ASN.1 types
3369 ENUMERATED and SET OF.
3371 * Added 'const' to some of the char pointer arguments for the
3372 functions, data1_read_node, data1_getelementbytagname,
3373 data1_insert_taggeddata, data1_getesetbyname, data1_getelementbyname,
3376 Fixed bug in data1_insert_taggeddata - the last_child member of
3377 parent wasn't initialised.
3379 * Changed data1_read_record and data1_read_node so that the supplied
3380 "SGML"-buffer is read-only. In particular the resulting data1 - tree
3381 doesn't refer to any parts of the "SGML"-buffer.
3383 Fixed bug in server library (Windows version of statserv_remove).
3385 * Changed code so that it compiles as C++. The type definition
3386 of Odr_fun which is a member of Odr_arm was changed. The result is,
3387 that an explicit typecast is needed for the fun pointer when
3388 using Odr_arm - as in:
3389 {1, -1, -1, Z_IdAuthentication_idPass, (Odr_fun)z_IdPass},
3391 Updated TagSet-G and -M definitions (tagsetm.tag and tagsetg.tag).
3393 Implemented the new structured date and time definition as approved
3394 by the ZIG. Added schemaId element to the specificTag in Espec-1
3395 (also approved at the last ZIG). Thanks to RVDM.
3397 Added some Object identifiers (RVDM).
3399 Changed the Update Extended Service (RVDM).
3401 Added command "refid" to client which specifies referenceId for
3402 the following requests.
3404 Implemented extended service handling for server. See ztest.c
3405 for an example as well as backend.h. New handlers are registerd
3406 in the Init handler.
3408 * Changed interface for sort in server.
3410 Added new members to statserv_options_block. It allows a server
3411 to read options from another source than just the command line. Thanks
3412 to Charles Woodfield.
3414 * Changed definition of Z_Triple in file prt-grs.h - member boolean
3415 renamed to zboolean. Some C++ compilers complained about the name.
3417 Minor changes to gils.abs. Added index 's' (sort) on title
3418 and date/time-last-modified.
3420 --- 1.4pl2 1998/1/30
3422 Fixed bug in server library regarding inetd mode (-i). This bug
3423 was introduced by release 1.4.
3425 --- 1.4pl1 1998/1/29
3427 Added sort facility in client and backend server interface.
3429 Fixed problem with dependencies in Makefile(s).
3431 Fixed bugs for encoders/decoders of extended services and
3434 Implemented sub-tree feature for schemas. Sub-trees are
3435 referenced in *.abs-files. See explain.abs for an example
3436 of the use of this feature.
3438 Modified bib1.att; local attributes for ANY didn't include
3439 ANY itself (only affects use of the retrieval module).
3441 Fixed bug in plain SGML reader in function data1_read_node:
3442 tags with prefix "var" was incorrectly interpreted as variants.
3444 Added feature "sub-schemas" to enable references to - and definitions
3445 of - group of elements.
3447 * Removed member parent from type data1_element (in data1.h).
3449 Implemented function odr_nullval() that returns the value of
3452 * Removed member num_children from data1_node (in data1.h).
3454 Made NT service interface part of the server library. The
3455 function statserv_main uses the NT service when required and
3456 calls the statserv_start / statserv_close routines.
3458 Routine zget_SearchRequest and zget_PresentRequest fills
3459 resultSetName/Id member with "default" instead of "Default".
3461 Fixed memory leak in server. Request queue member wasn't freed.
3463 Fixed nmem_exit so that memory is freed.
3467 Revised the CCL parser utility to be thread safe.
3469 Added function, oid_ent_to_oid, to replace the function
3470 oid_getoidbyent, which is not thread safe.
3472 * Added nmem_init and nmem_exit to initialize and release
3473 NMEM resources. Function nmem_init should be called once in the
3474 initial thread before NMEM/ODR is used. statserv.c and client.c
3475 have been changed accordingly. The change was necessary to make
3476 NMEM thread safe. The NMEM memory pool is shared amongst threads
3477 in a process. Unix-based applications will still work fine without
3480 Added NT Services interface for the the Z39.50 (statserv) Server.
3481 Refer to the ztest.c source on the usage.
3483 Windows 95/NT port using MSVC5.0. Project files are included in the
3486 * Defined new 'global' handle for the retrieval (data1) system. The
3487 new handled, data1_handle, describes the state of the data1 system.
3488 This handle is passed as first argument to virtually all
3489 data1 related routines. The functions data1_create and data1_destroy
3490 creates and destroys a data1 handle respectively.
3492 Added ODR encode stream member to all backend request structures
3493 init, search, scan etc. This stream should be used to allocate all
3494 memory used for the response when thread safe operation is needed.
3496 Changed the comstack utility, cs_addstr, to be thread safe. The
3497 returned hostname string returned by the function is now part the
3500 Added comstack utility, cs_straddr, which replaces the tcpip_strtoaddr
3501 function. The cs_straddr takes a COMSTACK handle as argument, so this
3502 function must be used after cs_create and before bind/connect.
3503 This function is thread safe.
3505 Moved test server to 'ztest' directory - generic server code still
3506 in 'server' directory.
3508 Made prefix query (pquery.c) utility thread safe.
3510 Added new function modifier YAZ_EXPORT to 'export' public DLL
3511 functions when using windows (see include/yconfig.h).
3513 Added definitions to the OID database (util/oid.c) (RVDM).
3515 Added new BIB-1 diagnostic messages to the handler diagbib1_str.
3517 Added call to ccl_rpn_delete in client program.
3519 Added ODR argument to ccl_rpn_query and ccl_scan_query to provide
3520 release of RPN structure.
3522 Added support for C++, headers uses extern "C" for public definitions.
3523 With input from RVDM.
3525 In handling of SEQUENCE OF: Counter set to zero when SEQUENCE OF is absent.
3526 Thanks to Ronald van der Meer (RVDM).
3528 Added initializers (zget_ routines) for a number of PDUs. Thanks to RVDM.
3530 Added support for private extensions to the OID database
3531 (oid_setprivateoids()). Thanks to RVDM.
3533 Added optional, physical ANY (key replication)
3535 Fixed null-reference problem in GRS-1 output filter.
3537 Proximity operator added to Prefix Query Format (PQF).
3539 In test client command "base" accepts multiple databases.
3541 Fixed bug in cs_close stack that caused trouble with WINSOCK.
3545 Fixed tagging bug in ResourceReportResponse PDU encoder/decode.
3547 Smallish bug-fixes in the new encoders/decoders (explain).
3549 Bug fixed in DeleteRequest.
3551 Fixed tagging bug of type 101 query in SearchRequest-Query PDU encoder/decoder.
3553 Fixed tagging bug in ResourceReportResponse PDU encoder/decode.
3555 Added SOIF syntax (using private OID for now) to retrieval module and client.
3557 Added Update extended service.
3559 Added SearchResult-1 additional info structure.
3561 Added optional CCL (ISO8777) interpreter as separate module. Available
3564 --- 1.2 1996/6/10 (1st anniversary release)
3566 Added Summary record syntax. Lightly tested.
3568 Added OPAC record syntax. Untested.
3570 Added ResourceReport service encoders/decoders. Untested.
3572 Fixed bug in z_Unit - wrong tagging on unitSystem.
3574 Fixed bug in the DiagRecs decoder.
3576 Added options for max PDU size and session timeout to frontend-server.
3578 Added documentation of query-language parsers and other supporting utilities.
3580 [frontend-server] Added Attribute set to the bend_scanrequest API.
3582 [frontend-server] NextResultSetPosition was sometimes set incorrectly when
3583 surrogate diagnostics were generated.
3585 [retrieval] Allow multiple local values for attribute.
3587 [retrieval] Allow multiple attributes per element in .abs files. index type.
3589 [retrieval] Added Summary tagset, abstract syntax, and d1-node/ASN filter.
3591 --- 1.1pl2 1996/4/10
3593 Minor changes, mostly specific to Zebra's requirements (retrieval)
3597 Repaired bug in frontend server when running multiple listening
3598 endpoints in dynamic mode.
3600 z_External() now won't break if a known, ASN.1 value comes encapsulated
3601 in an octet-string. The value will pass through unmodified in an Odr_oct.
3603 Added a bit of code to the demo client to decode & display
3604 ASN.1-structured records represented in the octet-aligned branch of
3605 the EXTERNAL CHOICE. Thanks to CAS for prodding us to finally do this.
3607 Added z_ext_getentbyref() to the ASN module. Doc updated.
3609 * Completed the SCAN definition in the ASN module. This may break SCAN
3610 code based on older YAZ-versions at compile-time. The fix is easy -
3613 * Added 'displayTerm' and OtherInformation to the TermInfo structure
3614 under the SCAN definition. Remember to initialize this, server-people.
3616 Comstack should now support the WAIS protocol in TCP/IP mode. Note
3617 that this does not extend to ODR and ASN.
3619 Comstack allows insertion of established socket (primarily for
3620 inetd-operation of servers). Doc updated.
3622 Front-end server can now start from the inetd in TCP mode. Doc
3625 --- 1.0pl4 1996/1/24
3629 Fixed small problem in SUTRS-filter. A newline was sometimes inserted before
3630 the rank and record number.
3632 Adjustments to the frontend server.
3634 Fixed diagnostic BER dumper. It ignored the file argument.
3638 Various changes to retrieval module.
3640 Changed the union discriminators of the protocol files from enums to
3641 ints paired with #defines.
3643 *Changed oident.class to oident.oclass to avoid a reserved word in C++
3646 *Changed operator in the RPN structure to 'roperator', again to avoid a
3649 Fixed problems in Explain decoders/encoders.
3651 --- 1.0pl2 1995/12/6
3653 Memory bug in log module fixed.
3655 --- 1.0pl1 1995/12/5
3657 Occasional malloc() of 0 bytes fixed in d1_espec.c.
3659 Bug in Explain DatabaseInfo module fixed.
3661 Some '\r' snuck into one or two of the ret'l config tables. A curse on Windows.
3665 The shift to v1.0 signals that we now consider the *core* functionality
3666 of YAZ reasonably stable (the core being more or less equivalent to
3667 Z39.50-1992). Some of the really nifty v3 stuff is still not heavily
3668 tested (Explain not at all - though that will happen soonish).
3670 Minor changes to code to support Windows port.
3672 Various minor changes after we're getting to use GRS-1 & co. more.
3674 Added Espec-1 format.
3676 Added VisibleString field body type to GRS-1. It is illegal acc. to my copy
3677 of the protocol and it cannot be selected when encoding (maps into 'string'
3678 when decoding). Needed to talk to some servers.
3680 Demo client can request simple element set names.
3682 Added Diagnostic Format encoders/decoders.
3684 Added simple Close handling to frontend server (no hooks for resource
3685 reporting yet), and demonstration client.
3687 Added cs_addrstr() command to COMSTACK to retrieve peer hostname/address.
3689 --- 1.0b3 1995/08/24
3691 Fixed bug in the frontend-server. The numberOfRecordsReturned field was
3692 handled incorrectly when records were requested in the searchResponse. This
3693 will only affect you if you use the frontend-server.
3695 Added GRS-1 encoders/decoders to the service-level API. Lightly tested.
3696 Test-client will ask for and print GRS1. Ztest will return dummy records
3699 Added Explain encoders/decoders to the service-level API. Untested.
3701 Added Extended Services: Item Order encoders and decoders to the Service-
3702 level API. Untested. We could use a recent copy of the pertinent bits
3703 of the ILL protocol to add those bits.
3705 Added diagnostic format 1 encoders/decoders to the service-level API.
3708 Moved pretty-printing of structure-wrappers ({..}) from odr_seq.c to
3709 odr_cons.c, which causes a more correct output.
3711 Fixed handling of searchRequest in frontend server. NextResultSetPosition
3712 was always set to 0 when no records were requested in the searchRequest.
3714 * Added better external-handling. This shouldn't harm old code that
3715 *encodes* externals. It can break code that looks for a
3716 'single-ASN1-type' representation, since those types that are known
3717 are now decoded immediately. Look at the SUTRS sample code in
3718 seshigh.c and client.c. Documentation updated.
3720 Handling of structured records in bend_fetchresponse. Length -1 marks
3721 structured record, type is deduced from format field.
3723 --- 1.0b2 1995/06/27
3724 Fairly quick maintenance release to add SUTRS support.
3726 Fixed handling of SUTRS records in the demonstration client.
3728 * Added format field to the bend_fetchrequest and bend_fetchresponce
3729 structures of the backend API (frontend server). When the record is
3730 returned, the value of the format field is mapped to an OID. The
3731 value VAL_SUTRS will also cause a slightly different ASN.1 packaging
3732 of the record. The special value VAL_NONE in the bend_request means
3733 that no specific format was requested by the client. Documentation
3734 updated accordingly. Test server (ztest) will return a fixed dummy
3735 SUTRS record if your client requests SUTRS.
3737 Documentation updated accordingly.
3739 You can now set external libraries and RANLIB support in the top-level
3743 First public release.