metaproxy-moved-to-github.git
12 years agoUse new diagnostic for proxy failures
Adam Dickmeiss [Wed, 25 Apr 2012 08:32:54 +0000 (10:32 +0200)]
Use new diagnostic for proxy failures

12 years agoRequire YAZ 4.2.32 or later for build
Adam Dickmeiss [Wed, 25 Apr 2012 08:21:27 +0000 (10:21 +0200)]
Require YAZ 4.2.32 or later for build

12 years agoMake check_proxy, you know ... work
Adam Dickmeiss [Wed, 25 Apr 2012 07:47:59 +0000 (09:47 +0200)]
Make check_proxy, you know ... work

12 years agoVersion 1.3.32 v1.3.32
Adam Dickmeiss [Tue, 24 Apr 2012 13:05:50 +0000 (15:05 +0200)]
Version 1.3.32

12 years agosru_z3950: pass through incoming Z39.50 requests
Adam Dickmeiss [Tue, 24 Apr 2012 12:58:08 +0000 (14:58 +0200)]
sru_z3950: pass through incoming Z39.50 requests

sru_z3950 filter passes through incoming Z39.50 requests again. Was
not handled by mistake in Metaproxy versions 1.3.29, 1.3.30 and 1.3.31.

12 years agoDo not build for Debian lenny anymore
Adam Dickmeiss [Tue, 24 Apr 2012 12:30:08 +0000 (14:30 +0200)]
Do not build for Debian lenny anymore

12 years agoVersion 1.3.31 v1.3.31
Adam Dickmeiss [Tue, 24 Apr 2012 10:31:24 +0000 (12:31 +0200)]
Version 1.3.31

12 years agozoom: refactor retry logic to separate function
Adam Dickmeiss [Tue, 24 Apr 2012 10:26:46 +0000 (12:26 +0200)]
zoom: refactor retry logic to separate function

12 years agozoom: properly handle proxy failover for re-used backends
Adam Dickmeiss [Tue, 24 Apr 2012 10:08:36 +0000 (12:08 +0200)]
zoom: properly handle proxy failover for re-used backends

Also log the diagnostic that is received from the backend in
case of retry/failover because they will be not be returned
via Z39.50/SRU.

12 years agoVersion 1.3.30 v1.3.30
Adam Dickmeiss [Mon, 23 Apr 2012 18:07:15 +0000 (20:07 +0200)]
Version 1.3.30

12 years agoUpdate NEWS
Adam Dickmeiss [Mon, 23 Apr 2012 18:02:48 +0000 (20:02 +0200)]
Update NEWS

12 years agozoom: proxy error returns diagnostic Bib-1:1014 / SRU:3
Adam Dickmeiss [Sat, 21 Apr 2012 08:35:14 +0000 (10:35 +0200)]
zoom: proxy error returns diagnostic Bib-1:1014 / SRU:3

12 years agozoom: return addinfo="proxy failure" for proxy failures
Adam Dickmeiss [Sat, 21 Apr 2012 08:24:44 +0000 (10:24 +0200)]
zoom: return addinfo="proxy failure" for proxy failures

This commit also changes the scheme for dealing with proxies a bit.
zoom now always do "proxy-check", even if there's no failover.
Fortunately, that's not very expensive.

12 years agozoom: implement cunning scheme for retry/proxy failover
Adam Dickmeiss [Fri, 20 Apr 2012 13:00:07 +0000 (15:00 +0200)]
zoom: implement cunning scheme for retry/proxy failover

12 years agosession_shared: disable session retry by default
Adam Dickmeiss [Fri, 20 Apr 2012 12:58:29 +0000 (14:58 +0200)]
session_shared: disable session retry by default

Can be enabled by restart="true" in resultset section.

12 years agozoom: guess if invalid response was an auth failure
Adam Dickmeiss [Fri, 20 Apr 2012 09:16:47 +0000 (11:16 +0200)]
zoom: guess if invalid response was an auth failure

12 years agozoom: Init rejected wo diagnostics maps to Bib-1:1014
Adam Dickmeiss [Fri, 20 Apr 2012 08:54:41 +0000 (10:54 +0200)]
zoom: Init rejected wo diagnostics maps to Bib-1:1014

Bib-1 1014, "Init/AC: Authentication System error", seems pretty
generic. We don't know why the init would fail; IP, user, block IP, etc.
sru_z3950 filter maps this to SRU diagnostic 3: "Authentication error".

12 years agoVersion 1.3.29 v1.3.29
Adam Dickmeiss [Wed, 18 Apr 2012 11:25:27 +0000 (13:25 +0200)]
Version 1.3.29

12 years agozoom: update zoom info on contentProxy
Adam Dickmeiss [Wed, 18 Apr 2012 11:24:31 +0000 (13:24 +0200)]
zoom: update zoom info on contentProxy

12 years agoUpdate NEWS
Adam Dickmeiss [Wed, 18 Apr 2012 11:18:15 +0000 (13:18 +0200)]
Update NEWS

12 years agozoom: may read cf-proxy's config settings
Adam Dickmeiss [Wed, 18 Apr 2012 10:20:20 +0000 (12:20 +0200)]
zoom: may read cf-proxy's config settings

This reduces manual configuration of the content proxy server host.
The %s notation for server is no longer supported. The ZOOM module will
use the old style session.proxyhost if "server" is given (deprecated)
and use the new style proxyhost/session if "config_file" is in use.

12 years agoMinor updates to config zoom example
Adam Dickmeiss [Wed, 18 Apr 2012 08:16:55 +0000 (10:16 +0200)]
Minor updates to config zoom example

12 years agozoom: more configurable format for contentProxy@server
Adam Dickmeiss [Wed, 18 Apr 2012 08:13:37 +0000 (10:13 +0200)]
zoom: more configurable format for contentProxy@server

The proxy attribute of contentProxy element may include a %s magic,
which will be substituted by the session ID. For example
server="proxy.indexdata.com/%s"

12 years agozoom: simplify cproxyhost XSLT parm passing
Adam Dickmeiss [Tue, 17 Apr 2012 09:28:25 +0000 (11:28 +0200)]
zoom: simplify cproxyhost XSLT parm passing

12 years agoRemove incoming requests that can not be handled
Adam Dickmeiss [Tue, 17 Apr 2012 08:33:12 +0000 (10:33 +0200)]
Remove incoming requests that can not be handled

Requests in queue for filter frontend_net are removed if client
closes connection for the session and request is not yet handled.

12 years agosru_z3950: serialize requests
Adam Dickmeiss [Mon, 16 Apr 2012 12:56:48 +0000 (14:56 +0200)]
sru_z3950: serialize requests

This is to ensure that pipelined HTTP requests are handled
properly.

12 years agosru_z3950: reformat; remove useless comments
Adam Dickmeiss [Fri, 13 Apr 2012 12:14:15 +0000 (14:14 +0200)]
sru_z3950: reformat; remove useless comments

12 years agoFix metaproxy.prerm: missing /bin/sh header
Adam Dickmeiss [Wed, 4 Apr 2012 15:46:23 +0000 (17:46 +0200)]
Fix metaproxy.prerm: missing /bin/sh header

12 years agoVersion 1.3.28 v1.3.28
Adam Dickmeiss [Wed, 4 Apr 2012 11:40:27 +0000 (13:40 +0200)]
Version 1.3.28

12 years agozoom: remove 'xslt successful' message
Adam Dickmeiss [Wed, 4 Apr 2012 08:34:24 +0000 (10:34 +0200)]
zoom: remove 'xslt successful' message

12 years agoNew WRBUF wrapper mp::wrbuf
Adam Dickmeiss [Wed, 4 Apr 2012 08:33:53 +0000 (10:33 +0200)]
New WRBUF wrapper mp::wrbuf

12 years agoVersion 1.3.27 v1.3.27
Adam Dickmeiss [Fri, 30 Mar 2012 11:18:57 +0000 (13:18 +0200)]
Version 1.3.27

12 years agoMetaproxy conflicts with CF 2.12.5 and earlier
Adam Dickmeiss [Fri, 30 Mar 2012 11:14:00 +0000 (13:14 +0200)]
Metaproxy conflicts with CF 2.12.5 and earlier

This is because Metaproxy is running as a different user now -
and old lock files etc, previously created as "nobody" would cause
permission problems for CF.

12 years agoUser info in /etc/metaproxy/metaproxy.user
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:49 +0000 (10:14 +0200)]
User info in /etc/metaproxy/metaproxy.user

12 years agoDebian compat 5
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:30 +0000 (10:14 +0200)]
Debian compat 5

12 years agoRPM: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 13:12:32 +0000 (13:12 +0000)]
RPM: metaproxy running as user "metaproxy"

12 years agoDebian: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 11:08:34 +0000 (13:08 +0200)]
Debian: metaproxy running as user "metaproxy"

New scripts to create and remove this user during installation
and removal.

12 years agoVersion 1.3.26 v1.3.26
Adam Dickmeiss [Tue, 20 Mar 2012 09:58:57 +0000 (10:58 +0100)]
Version 1.3.26

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 20 Mar 2012 09:57:24 +0000 (10:57 +0100)]
Update NEWS

12 years agoRPM metaproxy.xml: add comment about logging
Adam Dickmeiss [Tue, 20 Mar 2012 09:46:58 +0000 (10:46 +0100)]
RPM metaproxy.xml: add comment about logging

in the frontend net filter.

12 years agoSort module documentation, schema, fixes
Adam Dickmeiss [Tue, 20 Mar 2012 09:23:38 +0000 (10:23 +0100)]
Sort module documentation, schema, fixes

12 years agosort: cache sorted records
Adam Dickmeiss [Mon, 19 Mar 2012 22:03:30 +0000 (23:03 +0100)]
sort: cache sorted records

So they can be refetched invidually for example.

12 years agoSort filter using xpath result for sort criteria
Adam Dickmeiss [Mon, 19 Mar 2012 19:15:40 +0000 (20:15 +0100)]
Sort filter using xpath result for sort criteria

Sort order may be given in configuration.

12 years agoFurther work on sort filter .
Adam Dickmeiss [Mon, 19 Mar 2012 15:08:32 +0000 (16:08 +0100)]
Further work on sort filter .

Using x-path for getting score, but this is not yet in use.

12 years agosort: add skeleton for new sort filter
Adam Dickmeiss [Mon, 19 Mar 2012 09:13:24 +0000 (10:13 +0100)]
sort: add skeleton for new sort filter

12 years agotemplate: Use full configure for Impl configure
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:19 +0000 (10:12 +0100)]
template: Use full configure for Impl configure

12 years agoRemove useless comment
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:07 +0000 (10:12 +0100)]
Remove useless comment

12 years agomulti: adjust mediumSetPresentNumber to disable piggyback
Adam Dickmeiss [Fri, 16 Mar 2012 12:42:47 +0000 (13:42 +0100)]
multi: adjust mediumSetPresentNumber to disable piggyback

The value was adjusted from 1 to 0.. It should not make a difference,
but still.

12 years agoProtect the two Usemarcon handles
Adam Dickmeiss [Thu, 8 Mar 2012 16:28:14 +0000 (17:28 +0100)]
Protect the two Usemarcon handles

Multiple threads may use these. Allow only one at a time.

12 years agoUpdate scheme for XSLT parms
Adam Dickmeiss [Thu, 8 Mar 2012 15:59:34 +0000 (16:59 +0100)]
Update scheme for XSLT parms

This is actually supported in next YAZ version

12 years agovirt_db: remove query-encoding facility
Adam Dickmeiss [Thu, 8 Mar 2012 12:21:39 +0000 (13:21 +0100)]
virt_db: remove query-encoding facility

It's not in use and not documented.

12 years agomulti: allow backend-auth to be given for target element
Adam Dickmeiss [Thu, 8 Mar 2012 12:18:07 +0000 (13:18 +0100)]
multi: allow backend-auth to be given for target element

12 years agoconfigure: fix check for YAZ version
Adam Dickmeiss [Thu, 8 Mar 2012 10:03:53 +0000 (11:03 +0100)]
configure: fix check for YAZ version

12 years agouse outputcharset in example
Adam Dickmeiss [Thu, 8 Mar 2012 08:59:42 +0000 (09:59 +0100)]
use outputcharset in example

12 years agoupdate retrievalinfo schema
Adam Dickmeiss [Thu, 8 Mar 2012 08:56:48 +0000 (09:56 +0100)]
update retrievalinfo schema

Allow outputcharset (missing and supported for quite some time)
and leaderspec (new in YAZ 4.2.29).

12 years agomulti: empty route pattern uses route as default
Adam Dickmeiss [Thu, 8 Mar 2012 08:53:36 +0000 (09:53 +0100)]
multi: empty route pattern uses route as default

That is
 <target route="z3950.indexdata.com">z3950.indexdata.com</route>
may use the shorter notation
 <target route="z3950.indexdata.com"/>

12 years agoquery_rewrite: use config path to locate XSLT
Adam Dickmeiss [Wed, 7 Mar 2012 14:01:40 +0000 (15:01 +0100)]
query_rewrite: use config path to locate XSLT

12 years agoAdd include of sstream header
Adam Dickmeiss [Tue, 6 Mar 2012 12:04:49 +0000 (12:04 +0000)]
Add include of sstream header

12 years agoFilter frontend_net may log statistics
Adam Dickmeiss [Tue, 6 Mar 2012 11:44:50 +0000 (12:44 +0100)]
Filter frontend_net may log statistics

If a custom message element in frontend_net configuration it makes
the frontend_net filter produce a log entry whenever an operation
is completed. The log is always written using yaz_log with the
custom message given, the package ID (session ID) , the time
the operation has been active (end-to-end) , the threads currently
active/total and the size of the request input/output queues.

12 years agoRequire YAZ 4.2.28
Adam Dickmeiss [Tue, 6 Mar 2012 11:39:39 +0000 (12:39 +0100)]
Require YAZ 4.2.28

This is because record_transform uses yaz_retrieval_configure_t
introduced in YAZ 4.2.28.

12 years agozoom: re-connect when database is reused
Adam Dickmeiss [Mon, 5 Mar 2012 13:09:54 +0000 (14:09 +0100)]
zoom: re-connect when database is reused

Re-connect is necessary if a connection is lost or a timeout occurs.
If not, we'll be seeing zero hits, when we shouldn't.

12 years agoMinor documentation updates.
Adam Dickmeiss [Fri, 2 Mar 2012 21:48:45 +0000 (22:48 +0100)]
Minor documentation updates.

12 years agoUpdate doc/common
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:09 +0000 (22:46 +0100)]
Update doc/common

12 years agorecord_transform: doc updates
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:04 +0000 (22:46 +0100)]
record_transform: doc updates

12 years agorecord_transform: new step usemarcon
Adam Dickmeiss [Fri, 2 Mar 2012 12:19:32 +0000 (13:19 +0100)]
record_transform: new step usemarcon

For calling USEMARCON to convert record(s).

12 years agoUpdate m4
Adam Dickmeiss [Fri, 2 Mar 2012 10:22:17 +0000 (11:22 +0100)]
Update m4

12 years agorecord_transform: honor piggyback searches
Adam Dickmeiss [Thu, 1 Mar 2012 10:29:06 +0000 (11:29 +0100)]
record_transform: honor piggyback searches

12 years agorecord_transform: remove some dead code
Adam Dickmeiss [Wed, 29 Feb 2012 13:56:27 +0000 (14:56 +0100)]
record_transform: remove some dead code

12 years agoReformat
Adam Dickmeiss [Wed, 29 Feb 2012 13:51:13 +0000 (14:51 +0100)]
Reformat

12 years agoquery_rewrite: charset conversion of query terms
Adam Dickmeiss [Wed, 29 Feb 2012 13:17:41 +0000 (14:17 +0100)]
query_rewrite: charset conversion of query terms

This is an optional feature. Enabled by element <charset> in
configuration with attribute 'from' and 'to' that specifies
from/to encodings. The default 'from' encoding is UTF-8.

12 years agoVersion 1.3.25 v1.3.25
Adam Dickmeiss [Wed, 29 Feb 2012 08:54:44 +0000 (09:54 +0100)]
Version 1.3.25

12 years agozoom: ccl_err_msg may return 0
Adam Dickmeiss [Wed, 29 Feb 2012 08:53:51 +0000 (09:53 +0100)]
zoom: ccl_err_msg may return 0

So use odr_strdup_null. Just in case.

12 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:49 +0000 (09:51 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy

12 years agozoom: doc updates WRT content proxy host
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:17 +0000 (09:51 +0100)]
zoom: doc updates WRT content proxy host

12 years agoRPM/Deb: compile with 4.2.27 or later
Adam Dickmeiss [Tue, 28 Feb 2012 20:07:38 +0000 (21:07 +0100)]
RPM/Deb: compile with 4.2.27 or later

This is to ensure CCL_ERR_TRUNC_NOT_.. defines that appeared in YAZ
4.2.27 are checked.

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 28 Feb 2012 16:07:56 +0000 (17:07 +0100)]
Update NEWS

12 years agozoom: Only base database as additional info
Adam Dickmeiss [Tue, 28 Feb 2012 16:06:11 +0000 (17:06 +0100)]
zoom: Only base database as additional info

When 'Database does not exist' is returned.

12 years agoMerge branch 'hide_errors'
Adam Dickmeiss [Tue, 28 Feb 2012 15:06:20 +0000 (16:06 +0100)]
Merge branch 'hide_errors'

12 years agomulti: document hideerrors
Adam Dickmeiss [Tue, 28 Feb 2012 15:06:01 +0000 (16:06 +0100)]
multi: document hideerrors

12 years agomulti: adjust schema for hideerrors
Adam Dickmeiss [Tue, 28 Feb 2012 15:02:57 +0000 (16:02 +0100)]
multi: adjust schema for hideerrors

12 years agomulti: hideerrors functional
Adam Dickmeiss [Tue, 28 Feb 2012 14:36:13 +0000 (15:36 +0100)]
multi: hideerrors functional

12 years agozoom: urlRecipe by default disabled
Adam Dickmeiss [Tue, 28 Feb 2012 14:37:51 +0000 (15:37 +0100)]
zoom: urlRecipe by default disabled

12 years agoMerge branch 'master' into hide_errors
Adam Dickmeiss [Tue, 28 Feb 2012 13:43:48 +0000 (14:43 +0100)]
Merge branch 'master' into hide_errors

12 years agozoom: insert generated-url before common XSLT
Adam Dickmeiss [Tue, 28 Feb 2012 13:03:21 +0000 (14:03 +0100)]
zoom: insert generated-url before common XSLT

12 years agozoom: content-proxy no longer part of generated-url
Adam Dickmeiss [Tue, 28 Feb 2012 12:54:16 +0000 (13:54 +0100)]
zoom: content-proxy no longer part of generated-url

12 years agomulti: initial work on hide_errors tweak
Adam Dickmeiss [Tue, 28 Feb 2012 12:23:25 +0000 (13:23 +0100)]
multi: initial work on hide_errors tweak

12 years agozoom: mention record_xsl
Adam Dickmeiss [Tue, 28 Feb 2012 11:50:17 +0000 (12:50 +0100)]
zoom: mention record_xsl

12 years agozoom: tweak element set rules
Adam Dickmeiss [Tue, 28 Feb 2012 11:31:48 +0000 (12:31 +0100)]
zoom: tweak element set rules

If element is not pz2/raw, use explain_xsp if present; if explain_xsp
is not present don't do any pz2 retrievals (old behavior).

12 years agozoom: extra XSLT with cproxyhost param
Adam Dickmeiss [Tue, 28 Feb 2012 11:23:47 +0000 (12:23 +0100)]
zoom: extra XSLT with cproxyhost param

The extra XSLT enabled by if record_xsl attribute is specified
for zooom configuration. This will make a final transform
(after pz2 transform) and will be passed parameter cproxyhost
if content proxy is enabled; not passed otherwise.

12 years agozoom: document timeout setting.
Adam Dickmeiss [Fri, 24 Feb 2012 12:13:09 +0000 (13:13 +0100)]
zoom: document timeout setting.

12 years agozoom: timeout is configurable
Adam Dickmeiss [Fri, 24 Feb 2012 12:07:37 +0000 (13:07 +0100)]
zoom: timeout is configurable

Set as value of attribute 'timeout' in element 'zoom' of configuration.

12 years agozoom: fix spelling for a few errors
Adam Dickmeiss [Fri, 24 Feb 2012 11:42:47 +0000 (12:42 +0100)]
zoom: fix spelling for a few errors

12 years agozoom: tune CCL to Z39.50 diagnostics mapping
Adam Dickmeiss [Fri, 24 Feb 2012 11:36:53 +0000 (12:36 +0100)]
zoom: tune CCL to Z39.50 diagnostics mapping

Throw Bib-1: 108 "Malformed query" for syntax errors and related ones;
throw Bib-1: 3 "Unsupported search" for everything else. Details from
the CCL parser is provided as additional-info.

12 years agoVersion 1.3.24 v1.3.24
Adam Dickmeiss [Thu, 23 Feb 2012 11:21:56 +0000 (11:21 +0000)]
Version 1.3.24

12 years agoUpdate NEWS
Adam Dickmeiss [Thu, 23 Feb 2012 11:18:52 +0000 (12:18 +0100)]
Update NEWS

12 years agoSwap elements resultset and session in example config
Adam Dickmeiss [Thu, 23 Feb 2012 10:51:16 +0000 (11:51 +0100)]
Swap elements resultset and session in example config

To make our schema checking happy.

12 years agoAvoid re-using backends for Explain searches
Adam Dickmeiss [Thu, 23 Feb 2012 10:41:44 +0000 (11:41 +0100)]
Avoid re-using backends for Explain searches

This fixes a bug where re-used IR-Explain---1 searches would
result in an empty response.

12 years agoReduce resultset ttl in config-zoom.xml example
Adam Dickmeiss [Thu, 23 Feb 2012 10:39:44 +0000 (11:39 +0100)]
Reduce resultset ttl in config-zoom.xml example

12 years agoSlightly different sample URL
Adam Dickmeiss [Mon, 20 Feb 2012 14:56:19 +0000 (15:56 +0100)]
Slightly different sample URL

12 years agoSkip missing ccl_map values
Adam Dickmeiss [Mon, 20 Feb 2012 14:55:17 +0000 (15:55 +0100)]
Skip missing ccl_map values