pazpar2-moved-to-github.git
14 years agoAdd new elements
Jakub Skoczen [Thu, 10 Dec 2009 16:17:29 +0000 (17:17 +0100)]
Add new elements

14 years agoStrip tabs
Jakub Skoczen [Thu, 10 Dec 2009 15:41:03 +0000 (16:41 +0100)]
Strip tabs

14 years agoUse en locale
Jakub Skoczen [Thu, 10 Dec 2009 15:34:42 +0000 (16:34 +0100)]
Use en locale

14 years agoChange encoding mergekey fields
Adam Dickmeiss [Thu, 10 Dec 2009 11:55:29 +0000 (12:55 +0100)]
Change encoding mergekey fields

Change encoding so harmonize with the "old" marc21.xsl mergekey
scheme. That is field and value pairs separated by space and with
no trailing space.

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 10 Dec 2009 11:41:34 +0000 (12:41 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoAdd namespace def
Jakub Skoczen [Thu, 10 Dec 2009 11:39:58 +0000 (12:39 +0100)]
Add namespace def

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 10 Dec 2009 11:37:17 +0000 (12:37 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoDescribe pz:xslt and the auto setting
Adam Dickmeiss [Thu, 10 Dec 2009 11:36:36 +0000 (12:36 +0100)]
Describe pz:xslt and the auto setting

14 years agoFix RPN to CQL mappings, i.e use string attributes
Adam Dickmeiss [Thu, 10 Dec 2009 11:32:36 +0000 (12:32 +0100)]
Fix RPN to CQL mappings, i.e use string attributes

14 years agoAdd citation element
Jakub Skoczen [Thu, 10 Dec 2009 10:19:42 +0000 (11:19 +0100)]
Add citation element

14 years agoRemove mergekey declaration
Jakub Skoczen [Thu, 10 Dec 2009 10:15:38 +0000 (11:15 +0100)]
Remove mergekey declaration

14 years agoMove mergekey definition to pazpar2.cfg
Jakub Skoczen [Thu, 10 Dec 2009 10:11:57 +0000 (11:11 +0100)]
Move mergekey definition to pazpar2.cfg

Moves mergekey definition away from the normalization stylesheets and
defines a mergekey common for all target types in pazpar2.cfg.

14 years agoUse Odr_int type for hit counts
Adam Dickmeiss [Tue, 1 Dec 2009 21:24:02 +0000 (22:24 +0100)]
Use Odr_int type for hit counts

Use the Odr_int type for hit counts. This is part of YAZ 3.0.47
and later and so configure checks for that.

14 years agoUpdate test_normalize for skiparticle fix
Adam Dickmeiss [Tue, 24 Nov 2009 19:29:38 +0000 (20:29 +0100)]
Update test_normalize for skiparticle fix

14 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 24 Nov 2009 11:45:13 +0000 (12:45 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

14 years agoWin32 makefile: dist depends nsi
Adam Dickmeiss [Tue, 24 Nov 2009 11:34:30 +0000 (12:34 +0100)]
Win32 makefile: dist depends nsi

14 years agoBump version, update NEWS v1.2.3
Adam Dickmeiss [Tue, 24 Nov 2009 11:23:35 +0000 (12:23 +0100)]
Bump version, update NEWS

14 years agoMetadata 'skiparticle works for ICU normalization
Adam Dickmeiss [Tue, 24 Nov 2009 11:19:35 +0000 (12:19 +0100)]
Metadata 'skiparticle works for ICU normalization

The skiparticle handling was only working for the 7-bit ASCII
normalization code before.

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Mike Taylor [Thu, 19 Nov 2009 16:33:09 +0000 (16:33 +0000)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoAdded error-reporting for the case where a HTTP response is 200 OK but
Mike Taylor [Thu, 19 Nov 2009 16:33:03 +0000 (16:33 +0000)]
Added error-reporting for the case where a HTTP response is 200 OK but
it does not contain any XML (for example because it is a
human-readable HTML page explaining what went wrong).
Removed obsolete CVS Id.

15 years agoUpdate test result WRT marcmap
Adam Dickmeiss [Thu, 12 Nov 2009 19:48:49 +0000 (20:48 +0100)]
Update test result WRT marcmap

marcmap no longer produces a mergekey so a unique mergekey is
generated instead in test.

15 years agoexplicitly state encoding as utf-8
Jason Skomorowski [Wed, 11 Nov 2009 13:02:36 +0000 (08:02 -0500)]
explicitly state encoding as utf-8
that probably took long than it was worth, but we want the output the same as xsl!

15 years agoput root element in pz namespace in marcmap output
Jason Skomorowski [Tue, 10 Nov 2009 15:00:56 +0000 (10:00 -0500)]
put root element in pz namespace in marcmap output

15 years agoI $ed where I should have *ed.
Jason Skomorowski [Thu, 5 Nov 2009 16:20:10 +0000 (11:20 -0500)]
I $ed where I should have *ed.

15 years agoMARC XML also includes MARC generally
Jason Skomorowski [Thu, 5 Nov 2009 15:57:13 +0000 (10:57 -0500)]
MARC XML also includes MARC generally

15 years agoAvoid useless temp
Adam Dickmeiss [Wed, 4 Nov 2009 12:01:29 +0000 (13:01 +0100)]
Avoid useless temp

15 years agoTesting: align test no and line no (_urls)
Adam Dickmeiss [Wed, 4 Nov 2009 12:00:34 +0000 (13:00 +0100)]
Testing: align test no and line no (_urls)

15 years agoTesting: use standard IFS for test URLs
Adam Dickmeiss [Wed, 4 Nov 2009 11:56:39 +0000 (12:56 +0100)]
Testing: use standard IFS for test URLs

Use standard IFS instead of new-line for testing. This allow us
to have multiple items on one line, thus ensuring that line #x is
test_#x in test result.

15 years agoDeal with empty fields for ranking
Adam Dickmeiss [Wed, 4 Nov 2009 11:48:12 +0000 (12:48 +0100)]
Deal with empty fields for ranking

Avoid division by length=0 in relevance_countwords.

15 years agoUpdate test results for new ranking
Adam Dickmeiss [Tue, 3 Nov 2009 14:08:44 +0000 (15:08 +0100)]
Update test results for new ranking

15 years agoModify length calculation for ranking
Adam Dickmeiss [Tue, 3 Nov 2009 14:03:41 +0000 (15:03 +0100)]
Modify length calculation for ranking

Use a different denominator (length) for per-field relevance
scoring.. Instead of length of all ranked fields we now use
length of individual fields (as if they were individual "free" text
fields). This will ensure that documents with a long field with no
match (say description) will not "hurt" a title match.

15 years agoRemove dead code for relevancy (trie stuff)
Adam Dickmeiss [Tue, 3 Nov 2009 12:15:27 +0000 (13:15 +0100)]
Remove dead code for relevancy (trie stuff)

15 years agoFix bytarget requests being stopped (bug #3087)
Adam Dickmeiss [Fri, 30 Oct 2009 21:45:28 +0000 (22:45 +0100)]
Fix bytarget requests being stopped (bug #3087)

Context global activeClients is set to 1 when a search is initiated
to ensure that if bytarget is executed it will be continued if
no response has been returned which would set activeClients (show,
stat).

15 years agoUpdate test result for new mergekey (marcmap)
Adam Dickmeiss [Tue, 27 Oct 2009 08:25:28 +0000 (09:25 +0100)]
Update test result for new mergekey (marcmap)

15 years agomarcmap mergekey missed author.
Jason Skomorowski [Tue, 27 Oct 2009 02:40:49 +0000 (22:40 -0400)]
marcmap mergekey missed author.

15 years agoTest return error if curl is not found
Adam Dickmeiss [Mon, 26 Oct 2009 16:00:57 +0000 (17:00 +0100)]
Test return error if curl is not found

15 years agoUpdate test results for diagnostic code
Adam Dickmeiss [Mon, 26 Oct 2009 09:20:49 +0000 (10:20 +0100)]
Update test results for diagnostic code

15 years agoDiagnostic member was not set on connection error. Fixed
Sebastian Hammer [Fri, 23 Oct 2009 18:40:03 +0000 (18:40 +0000)]
Diagnostic member was not set on connection error. Fixed

15 years agoNew setting: pz:pqf_strftime
Adam Dickmeiss [Tue, 20 Oct 2009 11:54:07 +0000 (13:54 +0200)]
New setting: pz:pqf_strftime

This setting does all what pqf_prefix does but more. It uses strftime
conversions and reserves %% for the original PQF.

15 years agoAdd test for custom attribute (description@tag)
Adam Dickmeiss [Tue, 20 Oct 2009 11:05:42 +0000 (13:05 +0200)]
Add test for custom attribute (description@tag)

15 years agoPreserve pz:metadata attributes
Adam Dickmeiss [Tue, 20 Oct 2009 10:52:16 +0000 (12:52 +0200)]
Preserve pz:metadata attributes

Pazpar2 now preserves pz:metadata attributes for non-merged
elements. This allows custom attributes to be passed through
to a user interface from records.

15 years agoConst value for record_metadata_init
Adam Dickmeiss [Tue, 20 Oct 2009 10:32:28 +0000 (12:32 +0200)]
Const value for record_metadata_init

15 years agoFix double xmlFree - occurred for XSLT failure
Adam Dickmeiss [Tue, 20 Oct 2009 10:02:57 +0000 (12:02 +0200)]
Fix double xmlFree - occurred for XSLT failure

15 years agoFix Host header for SRU/SRW - bug #3069
Adam Dickmeiss [Mon, 19 Oct 2009 14:50:57 +0000 (16:50 +0200)]
Fix Host header for SRU/SRW - bug #3069

15 years agoFix update settings for wildcard zurls
Adam Dickmeiss [Fri, 16 Oct 2009 21:57:54 +0000 (23:57 +0200)]
Fix update settings for wildcard zurls

15 years agoRefactor database code
Adam Dickmeiss [Thu, 15 Oct 2009 10:12:44 +0000 (12:12 +0200)]
Refactor database code

Filter handling now in database.c.

15 years agoAddd test case for per-session setting
Adam Dickmeiss [Thu, 15 Oct 2009 08:37:03 +0000 (10:37 +0200)]
Addd test case for per-session setting

15 years agoSessions may be added per-session.
Adam Dickmeiss [Thu, 15 Oct 2009 07:59:05 +0000 (09:59 +0200)]
Sessions may be added per-session.

Settings system refactoring which allows settings to be defined
per-session (session_database and database).

15 years agoUse PAZPAR2_USE_VALGRIND for test
Adam Dickmeiss [Thu, 15 Oct 2009 07:58:07 +0000 (09:58 +0200)]
Use PAZPAR2_USE_VALGRIND for test

If PAZPAR2_USE_VALGRIND=true, valgrind will be used for a test, eg
PAZPAR2_USE_VALGRIND=true ./test_http.sh .

15 years agoTest case for setting overrides
Adam Dickmeiss [Wed, 14 Oct 2009 14:32:24 +0000 (16:32 +0200)]
Test case for setting overrides

15 years agoSettings, bytarget + db out-of-range check
Adam Dickmeiss [Wed, 14 Oct 2009 14:29:36 +0000 (16:29 +0200)]
Settings, bytarget + db out-of-range check

Command bytarget with argument settings=1 will show settings
per target.. This is to be able to verify correct settings and
be able to test that they are correct. The database settings
array size is now also stored..  Problems with database settings
array is that if not carefull it will be too small (smaller
than dictionary per-service in settings).

15 years agoFix nasty bug of overrides not working
Adam Dickmeiss [Wed, 14 Oct 2009 14:27:48 +0000 (16:27 +0200)]
Fix nasty bug of overrides not working

15 years agoDeal with relevance values round-off case
Adam Dickmeiss [Tue, 13 Oct 2009 13:55:46 +0000 (15:55 +0200)]
Deal with relevance values round-off case

15 years agoSometimes it takes 2 sec for Pazpar2 to stop
Adam Dickmeiss [Tue, 13 Oct 2009 13:54:11 +0000 (15:54 +0200)]
Sometimes it takes 2 sec for Pazpar2 to stop

15 years agoMake reclist sorting stable
Adam Dickmeiss [Tue, 13 Oct 2009 11:48:58 +0000 (13:48 +0200)]
Make reclist sorting stable

Make reclist sorting stable by comparing mergekey for records if
relevance/title or other sorting criteria all match. This is merely
to ensure that our regressions tests works (reproducible output).

15 years agoDont include start,number for show tests
Adam Dickmeiss [Tue, 13 Oct 2009 11:28:50 +0000 (13:28 +0200)]
Dont include start,number for show tests

15 years agoReformat
Adam Dickmeiss [Tue, 13 Oct 2009 11:13:05 +0000 (13:13 +0200)]
Reformat

15 years agoFix type of mergekey
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:52 +0000 (13:03 +0200)]
Fix type of mergekey

15 years agoUpdate to host website
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:34 +0000 (13:03 +0200)]
Update to host website

15 years agoVersion 1.2.2 v1.2.2
Adam Dickmeiss [Tue, 13 Oct 2009 09:24:14 +0000 (11:24 +0200)]
Version 1.2.2

15 years agoDescribe filter,maxrecs,startrecs
Adam Dickmeiss [Tue, 13 Oct 2009 09:21:26 +0000 (11:21 +0200)]
Describe filter,maxrecs,startrecs

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 13 Oct 2009 09:20:39 +0000 (11:20 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoOperator for pz:recordfilter is ~ (tilde).
Adam Dickmeiss [Tue, 13 Oct 2009 09:19:15 +0000 (11:19 +0200)]
Operator for pz:recordfilter is ~ (tilde).

The operator used to be = (equals), but since pz:recordfilter only
does substring match it seems more natural to harmonize with the
filter semantics (which has ~ for substring, = for string match).

15 years agoDescribe pz:recordfilter
Adam Dickmeiss [Tue, 13 Oct 2009 09:18:36 +0000 (11:18 +0200)]
Describe pz:recordfilter

15 years agoReformat
Adam Dickmeiss [Tue, 13 Oct 2009 09:14:13 +0000 (11:14 +0200)]
Reformat

15 years agoSet ZOOM option start always for 0-case.
Adam Dickmeiss [Mon, 12 Oct 2009 20:32:52 +0000 (22:32 +0200)]
Set ZOOM option start always for 0-case.

For maxrecs=0 or maxrecs omitted, set ZOOM option "start".

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:35 +0000 (16:21 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoNew optional argument, startrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:19 +0000 (16:21 +0200)]
New optional argument, startrecs, for cmd=search

15 years agoEnable apdulog for test server
Adam Dickmeiss [Mon, 12 Oct 2009 14:15:15 +0000 (16:15 +0200)]
Enable apdulog for test server

15 years agoAdded two new fields
Heikki Levanto [Mon, 12 Oct 2009 11:59:09 +0000 (13:59 +0200)]
Added two new fields

856$i gets into electronic-format-instruction
856$q gets into electronic-fortmat-type
Needed for LOT

15 years agoNew optional argument, maxrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 10:22:40 +0000 (12:22 +0200)]
New optional argument, maxrecs, for cmd=search

15 years agoMake Pazpar2 work on Libxml2 2.4
Adam Dickmeiss [Mon, 12 Oct 2009 08:29:56 +0000 (10:29 +0200)]
Make Pazpar2 work on Libxml2 2.4

15 years agoUse curl for tests. No wget.
Adam Dickmeiss [Sat, 10 Oct 2009 20:18:27 +0000 (22:18 +0200)]
Use curl for tests. No wget.

Search for curl in PATH and run test if present. wget is no longer used -
because it does not return "empty" result if HTTP server returns error
(e.g 417) - and because wget on older systems don't work with Pazpar2
at all.

15 years agoAdd test for pz:maxrecs
Adam Dickmeiss [Fri, 9 Oct 2009 18:13:11 +0000 (20:13 +0200)]
Add test for pz:maxrecs

15 years agoAdjust presentChunk for low value of pz:maxrecs
Adam Dickmeiss [Fri, 9 Oct 2009 18:11:50 +0000 (20:11 +0200)]
Adjust presentChunk for low value of pz:maxrecs

Set presentChunk to pz:maxrecs if that is lower than 20 (default value
of presentChunk).

15 years agoMerge branch 'reclist_max_recs'
Adam Dickmeiss [Fri, 9 Oct 2009 14:41:45 +0000 (16:41 +0200)]
Merge branch 'reclist_max_recs'

15 years agoFix dump_records for cluster==0
Adam Dickmeiss [Fri, 9 Oct 2009 14:26:54 +0000 (16:26 +0200)]
Fix dump_records for cluster==0

15 years agoFixed size hash for some structures.
Adam Dickmeiss [Fri, 9 Oct 2009 13:14:41 +0000 (15:14 +0200)]
Fixed size hash for some structures.

Fixed size hash lists for termlists, reclists.. Remove global variable
parameters.toget.

15 years agoUpdate sample cclmap for SRU test server
Adam Dickmeiss [Fri, 9 Oct 2009 12:32:47 +0000 (14:32 +0200)]
Update sample cclmap for SRU test server

The cclmap settings now use the string use-attribute which is the
name of the CCL search field. This config uses cql_transform_rpn2cql
without the need for pqf.properties. See also bug #2978.

15 years agoLog more for PQF to CQL conversion
Adam Dickmeiss [Fri, 9 Oct 2009 12:31:58 +0000 (14:31 +0200)]
Log more for PQF to CQL conversion

15 years agoPreserve order for insertion in reclist
Adam Dickmeiss [Thu, 8 Oct 2009 20:32:14 +0000 (22:32 +0200)]
Preserve order for insertion in reclist

Preserve for reclist insertion so that tests give same result.
Before this commit, results were correct but sorting would be
different for identical sortkeys (unstable sort).

15 years agoReclists work.
Adam Dickmeiss [Thu, 8 Oct 2009 13:56:18 +0000 (15:56 +0200)]
Reclists work.

15 years agoRemove unused code
Adam Dickmeiss [Thu, 8 Oct 2009 13:01:18 +0000 (15:01 +0200)]
Remove unused code

15 years agoRefactor: hide reclist structure
Adam Dickmeiss [Thu, 8 Oct 2009 12:52:34 +0000 (14:52 +0200)]
Refactor: hide reclist structure

15 years agoSubstring for all setting types.
Adam Dickmeiss [Thu, 8 Oct 2009 10:47:48 +0000 (12:47 +0200)]
Substring for all setting types.

Change match_criterion so that substring (~) match uses strstr
always. The equal/string (=) uses match_zurl magic and strcmp as
before. This also ensure that v ptr is always set at end of routine
to prevent undefined behavior.

15 years agoTwo searches with filter args
Adam Dickmeiss [Thu, 8 Oct 2009 10:39:34 +0000 (12:39 +0200)]
Two searches with filter args

15 years agoSimplify again
Adam Dickmeiss [Thu, 8 Oct 2009 10:38:09 +0000 (12:38 +0200)]
Simplify again

15 years agoUpdate test for other filter parsing
Adam Dickmeiss [Thu, 8 Oct 2009 10:35:20 +0000 (12:35 +0200)]
Update test for other filter parsing

15 years agoparse_filter: spelling and more readable
Adam Dickmeiss [Thu, 8 Oct 2009 10:33:06 +0000 (12:33 +0200)]
parse_filter: spelling and more readable

15 years agoFix filters parsing
Adam Dickmeiss [Thu, 8 Oct 2009 10:28:54 +0000 (12:28 +0200)]
Fix filters parsing

Fix the filter parsing so that equal name=value is working again.
In parse_filter, the eq would be set to NULL after finding '='.

15 years agoUpdate for relevence element in results
Adam Dickmeiss [Thu, 8 Oct 2009 07:57:42 +0000 (09:57 +0200)]
Update for relevence element in results

15 years agoAdded check for no transform steps
Sebastian Hammer [Wed, 7 Oct 2009 14:55:59 +0000 (16:55 +0200)]
Added check for no transform steps

15 years agoMerge branch 'master' of ssh://git/home/git/pub/pazpar2
Sebastian Hammer [Wed, 7 Oct 2009 14:08:01 +0000 (14:08 +0000)]
Merge branch 'master' of ssh://git/home/git/pub/pazpar2

15 years agoAdded relevance to return rec
Sebastian Hammer [Wed, 7 Oct 2009 14:07:49 +0000 (14:07 +0000)]
Added relevance to return rec

15 years agoShare similar XSLTs within session.
Adam Dickmeiss [Wed, 7 Oct 2009 13:37:20 +0000 (15:37 +0200)]
Share similar XSLTs within session.

XSLTs + MARC maps are cached within a session so we don't re-parse
them over and over again. Even for a session with a single search
there's much to be gained because many targets use the same
transformation.

15 years agorecord_to_xml, normalize_record static
Adam Dickmeiss [Wed, 7 Oct 2009 12:56:39 +0000 (14:56 +0200)]
record_to_xml, normalize_record static

15 years agoOther behavior misconfigured targets bug #2242
Adam Dickmeiss [Wed, 7 Oct 2009 12:35:41 +0000 (14:35 +0200)]
Other behavior misconfigured targets bug #2242

Pazpar2 will no longer return errors for individual targets .. such
as unknown stylesheets.. It will still be reported in the Pazpar2 log.
If all targets cannot be configured, it will return 'No targets'.

15 years agoFactor out record normalization
Adam Dickmeiss [Wed, 7 Oct 2009 12:19:14 +0000 (14:19 +0200)]
Factor out record normalization

15 years agoMergekey changes - order + required/optional.
Adam Dickmeiss [Wed, 7 Oct 2009 10:27:10 +0000 (12:27 +0200)]
Mergekey changes - order + required/optional.

The metadata attribute 'mergekey' now takes one of three values 'no',
'required', 'optional' .  And the resulting mergekey from metadata
is now ordered in the same way as metadata in the service definition.
Older Pazpar2 version use the order in which metadata appeared in a
record instance.

15 years agoRevert -V desc to be correct
Adam Dickmeiss [Wed, 7 Oct 2009 08:50:09 +0000 (10:50 +0200)]
Revert -V desc to be correct