pazpar2-moved-to-github.git
15 years agoModify length calculation for ranking
Adam Dickmeiss [Tue, 3 Nov 2009 14:03:41 +0000 (15:03 +0100)]
Modify length calculation for ranking

Use a different denominator (length) for per-field relevance
scoring.. Instead of length of all ranked fields we now use
length of individual fields (as if they were individual "free" text
fields). This will ensure that documents with a long field with no
match (say description) will not "hurt" a title match.

15 years agoRemove dead code for relevancy (trie stuff)
Adam Dickmeiss [Tue, 3 Nov 2009 12:15:27 +0000 (13:15 +0100)]
Remove dead code for relevancy (trie stuff)

15 years agoFix bytarget requests being stopped (bug #3087)
Adam Dickmeiss [Fri, 30 Oct 2009 21:45:28 +0000 (22:45 +0100)]
Fix bytarget requests being stopped (bug #3087)

Context global activeClients is set to 1 when a search is initiated
to ensure that if bytarget is executed it will be continued if
no response has been returned which would set activeClients (show,
stat).

15 years agoUpdate test result for new mergekey (marcmap)
Adam Dickmeiss [Tue, 27 Oct 2009 08:25:28 +0000 (09:25 +0100)]
Update test result for new mergekey (marcmap)

15 years agomarcmap mergekey missed author.
Jason Skomorowski [Tue, 27 Oct 2009 02:40:49 +0000 (22:40 -0400)]
marcmap mergekey missed author.

15 years agoTest return error if curl is not found
Adam Dickmeiss [Mon, 26 Oct 2009 16:00:57 +0000 (17:00 +0100)]
Test return error if curl is not found

15 years agoUpdate test results for diagnostic code
Adam Dickmeiss [Mon, 26 Oct 2009 09:20:49 +0000 (10:20 +0100)]
Update test results for diagnostic code

15 years agoDiagnostic member was not set on connection error. Fixed
Sebastian Hammer [Fri, 23 Oct 2009 18:40:03 +0000 (18:40 +0000)]
Diagnostic member was not set on connection error. Fixed

15 years agoNew setting: pz:pqf_strftime
Adam Dickmeiss [Tue, 20 Oct 2009 11:54:07 +0000 (13:54 +0200)]
New setting: pz:pqf_strftime

This setting does all what pqf_prefix does but more. It uses strftime
conversions and reserves %% for the original PQF.

15 years agoAdd test for custom attribute (description@tag)
Adam Dickmeiss [Tue, 20 Oct 2009 11:05:42 +0000 (13:05 +0200)]
Add test for custom attribute (description@tag)

15 years agoPreserve pz:metadata attributes
Adam Dickmeiss [Tue, 20 Oct 2009 10:52:16 +0000 (12:52 +0200)]
Preserve pz:metadata attributes

Pazpar2 now preserves pz:metadata attributes for non-merged
elements. This allows custom attributes to be passed through
to a user interface from records.

15 years agoConst value for record_metadata_init
Adam Dickmeiss [Tue, 20 Oct 2009 10:32:28 +0000 (12:32 +0200)]
Const value for record_metadata_init

15 years agoFix double xmlFree - occurred for XSLT failure
Adam Dickmeiss [Tue, 20 Oct 2009 10:02:57 +0000 (12:02 +0200)]
Fix double xmlFree - occurred for XSLT failure

15 years agoFix Host header for SRU/SRW - bug #3069
Adam Dickmeiss [Mon, 19 Oct 2009 14:50:57 +0000 (16:50 +0200)]
Fix Host header for SRU/SRW - bug #3069

15 years agoFix update settings for wildcard zurls
Adam Dickmeiss [Fri, 16 Oct 2009 21:57:54 +0000 (23:57 +0200)]
Fix update settings for wildcard zurls

15 years agoRefactor database code
Adam Dickmeiss [Thu, 15 Oct 2009 10:12:44 +0000 (12:12 +0200)]
Refactor database code

Filter handling now in database.c.

15 years agoAddd test case for per-session setting
Adam Dickmeiss [Thu, 15 Oct 2009 08:37:03 +0000 (10:37 +0200)]
Addd test case for per-session setting

15 years agoSessions may be added per-session.
Adam Dickmeiss [Thu, 15 Oct 2009 07:59:05 +0000 (09:59 +0200)]
Sessions may be added per-session.

Settings system refactoring which allows settings to be defined
per-session (session_database and database).

15 years agoUse PAZPAR2_USE_VALGRIND for test
Adam Dickmeiss [Thu, 15 Oct 2009 07:58:07 +0000 (09:58 +0200)]
Use PAZPAR2_USE_VALGRIND for test

If PAZPAR2_USE_VALGRIND=true, valgrind will be used for a test, eg
PAZPAR2_USE_VALGRIND=true ./test_http.sh .

15 years agoTest case for setting overrides
Adam Dickmeiss [Wed, 14 Oct 2009 14:32:24 +0000 (16:32 +0200)]
Test case for setting overrides

15 years agoSettings, bytarget + db out-of-range check
Adam Dickmeiss [Wed, 14 Oct 2009 14:29:36 +0000 (16:29 +0200)]
Settings, bytarget + db out-of-range check

Command bytarget with argument settings=1 will show settings
per target.. This is to be able to verify correct settings and
be able to test that they are correct. The database settings
array size is now also stored..  Problems with database settings
array is that if not carefull it will be too small (smaller
than dictionary per-service in settings).

15 years agoFix nasty bug of overrides not working
Adam Dickmeiss [Wed, 14 Oct 2009 14:27:48 +0000 (16:27 +0200)]
Fix nasty bug of overrides not working

15 years agoDeal with relevance values round-off case
Adam Dickmeiss [Tue, 13 Oct 2009 13:55:46 +0000 (15:55 +0200)]
Deal with relevance values round-off case

15 years agoSometimes it takes 2 sec for Pazpar2 to stop
Adam Dickmeiss [Tue, 13 Oct 2009 13:54:11 +0000 (15:54 +0200)]
Sometimes it takes 2 sec for Pazpar2 to stop

15 years agoMake reclist sorting stable
Adam Dickmeiss [Tue, 13 Oct 2009 11:48:58 +0000 (13:48 +0200)]
Make reclist sorting stable

Make reclist sorting stable by comparing mergekey for records if
relevance/title or other sorting criteria all match. This is merely
to ensure that our regressions tests works (reproducible output).

15 years agoDont include start,number for show tests
Adam Dickmeiss [Tue, 13 Oct 2009 11:28:50 +0000 (13:28 +0200)]
Dont include start,number for show tests

15 years agoReformat
Adam Dickmeiss [Tue, 13 Oct 2009 11:13:05 +0000 (13:13 +0200)]
Reformat

15 years agoFix type of mergekey
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:52 +0000 (13:03 +0200)]
Fix type of mergekey

15 years agoUpdate to host website
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:34 +0000 (13:03 +0200)]
Update to host website

15 years agoVersion 1.2.2 v1.2.2
Adam Dickmeiss [Tue, 13 Oct 2009 09:24:14 +0000 (11:24 +0200)]
Version 1.2.2

15 years agoDescribe filter,maxrecs,startrecs
Adam Dickmeiss [Tue, 13 Oct 2009 09:21:26 +0000 (11:21 +0200)]
Describe filter,maxrecs,startrecs

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 13 Oct 2009 09:20:39 +0000 (11:20 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoOperator for pz:recordfilter is ~ (tilde).
Adam Dickmeiss [Tue, 13 Oct 2009 09:19:15 +0000 (11:19 +0200)]
Operator for pz:recordfilter is ~ (tilde).

The operator used to be = (equals), but since pz:recordfilter only
does substring match it seems more natural to harmonize with the
filter semantics (which has ~ for substring, = for string match).

15 years agoDescribe pz:recordfilter
Adam Dickmeiss [Tue, 13 Oct 2009 09:18:36 +0000 (11:18 +0200)]
Describe pz:recordfilter

15 years agoReformat
Adam Dickmeiss [Tue, 13 Oct 2009 09:14:13 +0000 (11:14 +0200)]
Reformat

15 years agoSet ZOOM option start always for 0-case.
Adam Dickmeiss [Mon, 12 Oct 2009 20:32:52 +0000 (22:32 +0200)]
Set ZOOM option start always for 0-case.

For maxrecs=0 or maxrecs omitted, set ZOOM option "start".

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:35 +0000 (16:21 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoNew optional argument, startrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:19 +0000 (16:21 +0200)]
New optional argument, startrecs, for cmd=search

15 years agoEnable apdulog for test server
Adam Dickmeiss [Mon, 12 Oct 2009 14:15:15 +0000 (16:15 +0200)]
Enable apdulog for test server

15 years agoAdded two new fields
Heikki Levanto [Mon, 12 Oct 2009 11:59:09 +0000 (13:59 +0200)]
Added two new fields

856$i gets into electronic-format-instruction
856$q gets into electronic-fortmat-type
Needed for LOT

15 years agoNew optional argument, maxrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 10:22:40 +0000 (12:22 +0200)]
New optional argument, maxrecs, for cmd=search

15 years agoMake Pazpar2 work on Libxml2 2.4
Adam Dickmeiss [Mon, 12 Oct 2009 08:29:56 +0000 (10:29 +0200)]
Make Pazpar2 work on Libxml2 2.4

15 years agoUse curl for tests. No wget.
Adam Dickmeiss [Sat, 10 Oct 2009 20:18:27 +0000 (22:18 +0200)]
Use curl for tests. No wget.

Search for curl in PATH and run test if present. wget is no longer used -
because it does not return "empty" result if HTTP server returns error
(e.g 417) - and because wget on older systems don't work with Pazpar2
at all.

15 years agoAdd test for pz:maxrecs
Adam Dickmeiss [Fri, 9 Oct 2009 18:13:11 +0000 (20:13 +0200)]
Add test for pz:maxrecs

15 years agoAdjust presentChunk for low value of pz:maxrecs
Adam Dickmeiss [Fri, 9 Oct 2009 18:11:50 +0000 (20:11 +0200)]
Adjust presentChunk for low value of pz:maxrecs

Set presentChunk to pz:maxrecs if that is lower than 20 (default value
of presentChunk).

15 years agoMerge branch 'reclist_max_recs'
Adam Dickmeiss [Fri, 9 Oct 2009 14:41:45 +0000 (16:41 +0200)]
Merge branch 'reclist_max_recs'

15 years agoFix dump_records for cluster==0
Adam Dickmeiss [Fri, 9 Oct 2009 14:26:54 +0000 (16:26 +0200)]
Fix dump_records for cluster==0

15 years agoFixed size hash for some structures.
Adam Dickmeiss [Fri, 9 Oct 2009 13:14:41 +0000 (15:14 +0200)]
Fixed size hash for some structures.

Fixed size hash lists for termlists, reclists.. Remove global variable
parameters.toget.

15 years agoUpdate sample cclmap for SRU test server
Adam Dickmeiss [Fri, 9 Oct 2009 12:32:47 +0000 (14:32 +0200)]
Update sample cclmap for SRU test server

The cclmap settings now use the string use-attribute which is the
name of the CCL search field. This config uses cql_transform_rpn2cql
without the need for pqf.properties. See also bug #2978.

15 years agoLog more for PQF to CQL conversion
Adam Dickmeiss [Fri, 9 Oct 2009 12:31:58 +0000 (14:31 +0200)]
Log more for PQF to CQL conversion

15 years agoPreserve order for insertion in reclist
Adam Dickmeiss [Thu, 8 Oct 2009 20:32:14 +0000 (22:32 +0200)]
Preserve order for insertion in reclist

Preserve for reclist insertion so that tests give same result.
Before this commit, results were correct but sorting would be
different for identical sortkeys (unstable sort).

15 years agoReclists work.
Adam Dickmeiss [Thu, 8 Oct 2009 13:56:18 +0000 (15:56 +0200)]
Reclists work.

15 years agoRemove unused code
Adam Dickmeiss [Thu, 8 Oct 2009 13:01:18 +0000 (15:01 +0200)]
Remove unused code

15 years agoRefactor: hide reclist structure
Adam Dickmeiss [Thu, 8 Oct 2009 12:52:34 +0000 (14:52 +0200)]
Refactor: hide reclist structure

15 years agoSubstring for all setting types.
Adam Dickmeiss [Thu, 8 Oct 2009 10:47:48 +0000 (12:47 +0200)]
Substring for all setting types.

Change match_criterion so that substring (~) match uses strstr
always. The equal/string (=) uses match_zurl magic and strcmp as
before. This also ensure that v ptr is always set at end of routine
to prevent undefined behavior.

15 years agoTwo searches with filter args
Adam Dickmeiss [Thu, 8 Oct 2009 10:39:34 +0000 (12:39 +0200)]
Two searches with filter args

15 years agoSimplify again
Adam Dickmeiss [Thu, 8 Oct 2009 10:38:09 +0000 (12:38 +0200)]
Simplify again

15 years agoUpdate test for other filter parsing
Adam Dickmeiss [Thu, 8 Oct 2009 10:35:20 +0000 (12:35 +0200)]
Update test for other filter parsing

15 years agoparse_filter: spelling and more readable
Adam Dickmeiss [Thu, 8 Oct 2009 10:33:06 +0000 (12:33 +0200)]
parse_filter: spelling and more readable

15 years agoFix filters parsing
Adam Dickmeiss [Thu, 8 Oct 2009 10:28:54 +0000 (12:28 +0200)]
Fix filters parsing

Fix the filter parsing so that equal name=value is working again.
In parse_filter, the eq would be set to NULL after finding '='.

15 years agoUpdate for relevence element in results
Adam Dickmeiss [Thu, 8 Oct 2009 07:57:42 +0000 (09:57 +0200)]
Update for relevence element in results

15 years agoAdded check for no transform steps
Sebastian Hammer [Wed, 7 Oct 2009 14:55:59 +0000 (16:55 +0200)]
Added check for no transform steps

15 years agoMerge branch 'master' of ssh://git/home/git/pub/pazpar2
Sebastian Hammer [Wed, 7 Oct 2009 14:08:01 +0000 (14:08 +0000)]
Merge branch 'master' of ssh://git/home/git/pub/pazpar2

15 years agoAdded relevance to return rec
Sebastian Hammer [Wed, 7 Oct 2009 14:07:49 +0000 (14:07 +0000)]
Added relevance to return rec

15 years agoShare similar XSLTs within session.
Adam Dickmeiss [Wed, 7 Oct 2009 13:37:20 +0000 (15:37 +0200)]
Share similar XSLTs within session.

XSLTs + MARC maps are cached within a session so we don't re-parse
them over and over again. Even for a session with a single search
there's much to be gained because many targets use the same
transformation.

15 years agorecord_to_xml, normalize_record static
Adam Dickmeiss [Wed, 7 Oct 2009 12:56:39 +0000 (14:56 +0200)]
record_to_xml, normalize_record static

15 years agoOther behavior misconfigured targets bug #2242
Adam Dickmeiss [Wed, 7 Oct 2009 12:35:41 +0000 (14:35 +0200)]
Other behavior misconfigured targets bug #2242

Pazpar2 will no longer return errors for individual targets .. such
as unknown stylesheets.. It will still be reported in the Pazpar2 log.
If all targets cannot be configured, it will return 'No targets'.

15 years agoFactor out record normalization
Adam Dickmeiss [Wed, 7 Oct 2009 12:19:14 +0000 (14:19 +0200)]
Factor out record normalization

15 years agoMergekey changes - order + required/optional.
Adam Dickmeiss [Wed, 7 Oct 2009 10:27:10 +0000 (12:27 +0200)]
Mergekey changes - order + required/optional.

The metadata attribute 'mergekey' now takes one of three values 'no',
'required', 'optional' .  And the resulting mergekey from metadata
is now ordered in the same way as metadata in the service definition.
Older Pazpar2 version use the order in which metadata appeared in a
record instance.

15 years agoRevert -V desc to be correct
Adam Dickmeiss [Wed, 7 Oct 2009 08:50:09 +0000 (10:50 +0200)]
Revert -V desc to be correct

15 years agoExtra parantheses to make GCC happy
Adam Dickmeiss [Wed, 7 Oct 2009 08:49:14 +0000 (10:49 +0200)]
Extra parantheses to make GCC happy

15 years agoShow option -v in usage
Adam Dickmeiss [Wed, 7 Oct 2009 08:39:00 +0000 (10:39 +0200)]
Show option -v in usage

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Wed, 7 Oct 2009 08:31:08 +0000 (10:31 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoLog level may be set (option -v)
Adam Dickmeiss [Wed, 7 Oct 2009 08:30:11 +0000 (10:30 +0200)]
Log level may be set (option -v)

15 years agoSubstring matching for target selectiion.
Jason Skomorowski [Tue, 6 Oct 2009 16:13:44 +0000 (12:13 -0400)]
Substring matching for target selectiion.

15 years agoVersion 1.2.1 v1.2.1
Adam Dickmeiss [Mon, 5 Oct 2009 07:49:20 +0000 (09:49 +0200)]
Version 1.2.1

15 years agoMove sleep till after kill in test
Adam Dickmeiss [Fri, 2 Oct 2009 20:50:02 +0000 (22:50 +0200)]
Move sleep till after kill in test

15 years agoUse curl or wget for URL tests
Adam Dickmeiss [Fri, 2 Oct 2009 20:33:43 +0000 (22:33 +0200)]
Use curl or wget for URL tests

15 years agoURL encode [] to make curl happy
Adam Dickmeiss [Fri, 2 Oct 2009 20:32:20 +0000 (22:32 +0200)]
URL encode [] to make curl happy

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 1 Oct 2009 19:58:36 +0000 (21:58 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoConfigure checks for netlibs (-lnsl, -lsocket).
Adam Dickmeiss [Thu, 1 Oct 2009 19:51:11 +0000 (21:51 +0200)]
Configure checks for netlibs (-lnsl, -lsocket).

This should allow Pazpar2 to use getaddrinfo on Solaris.

15 years agoDo not use gethostbyname in threaded resolver
Adam Dickmeiss [Thu, 1 Oct 2009 19:45:52 +0000 (21:45 +0200)]
Do not use gethostbyname in threaded resolver

Only use threaded resolver when getaddrinfo is found by configure.

15 years agoUpdate NEWS WRT XML header
Adam Dickmeiss [Thu, 1 Oct 2009 07:25:40 +0000 (09:25 +0200)]
Update NEWS WRT XML header

15 years agoUpdate test due to XML header output.
Adam Dickmeiss [Tue, 29 Sep 2009 21:20:25 +0000 (23:20 +0200)]
Update test due to XML header output.

15 years agoXML declaration added to command output.
Jason Skomorowski [Tue, 29 Sep 2009 19:49:56 +0000 (15:49 -0400)]
XML declaration added to command output.
Bug #3051

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Jason Skomorowski [Tue, 29 Sep 2009 18:56:44 +0000 (14:56 -0400)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoSame fname scheme for mmap+xslt
Adam Dickmeiss [Tue, 29 Sep 2009 13:46:01 +0000 (15:46 +0200)]
Same fname scheme for mmap+xslt

15 years agoIs retired. Really.
Adam Dickmeiss [Tue, 29 Sep 2009 13:45:12 +0000 (15:45 +0200)]
Is retired. Really.

15 years agoChange proto to use const char ptr
Adam Dickmeiss [Tue, 29 Sep 2009 13:20:15 +0000 (15:20 +0200)]
Change proto to use const char ptr

15 years agoFix timeout setting to use operation
Adam Dickmeiss [Tue, 29 Sep 2009 11:38:51 +0000 (13:38 +0200)]
Fix timeout setting to use operation

15 years agoDifferent approach to selecting medium.
Adam Dickmeiss [Tue, 29 Sep 2009 09:18:34 +0000 (11:18 +0200)]
Different approach to selecting medium.

Instead of substring-after/substring-before, just remove "white-space"
chars - such as "[]/ " . At least one target has been seen to use / in
245$h.

15 years agoLog SHA1 version on start
Adam Dickmeiss [Tue, 29 Sep 2009 08:23:56 +0000 (10:23 +0200)]
Log SHA1 version on start

15 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 29 Sep 2009 07:48:22 +0000 (09:48 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2

15 years agoIntroduce Z39.50/SRU operation timeout.
Adam Dickmeiss [Tue, 29 Sep 2009 07:46:11 +0000 (09:46 +0200)]
Introduce Z39.50/SRU operation timeout.

Introduce operations timeout. It replaces connect timeout and is the
maximum waiting time before giving up an active operation. Its
default value is 30 seconds.

15 years agoFix for non-threaded resolver.
Adam Dickmeiss [Mon, 28 Sep 2009 21:46:26 +0000 (23:46 +0200)]
Fix for non-threaded resolver.

For the non-threaded host resolver, create_host may return NULL. This
in turn will make database-host a NULL ptr. This fixes
client_prep_connection to return if that's the case.

15 years agoUpdate for different -V output
Adam Dickmeiss [Mon, 28 Sep 2009 18:36:42 +0000 (20:36 +0200)]
Update for different -V output

Pazpar2 -V now shows icu:enabled if ICU is enabled.

15 years agopz:recordfilter form is name[=substring].
Adam Dickmeiss [Mon, 28 Sep 2009 18:18:50 +0000 (20:18 +0200)]
pz:recordfilter form is name[=substring].

pz:recordfilter is now of the form name[=substring]. A record is
included if metadata element is present and existing (substring
omitted) or includes substring (substring included).

15 years agoMergekey from XSL overrides mergekey=yes.
Adam Dickmeiss [Mon, 28 Sep 2009 11:56:27 +0000 (13:56 +0200)]
Mergekey from XSL overrides mergekey=yes.

If mergekey attribute is present in XSL (px:xslt), then value for that
is used (and value of elements defined in metadata mergekey=yes are not
used). OIf mergekey is not present, then value of metadata mergekey=yes
elements are used. An empty value mergekey from XSL will generate
a unique mergekey.

15 years agoJS: Use generic array for stats data.
Adam Dickmeiss [Mon, 28 Sep 2009 11:22:19 +0000 (13:22 +0200)]
JS: Use generic array for stats data.

The stat response data is now stored in an array based on element names.
This allow us to not keep in "sync" with the Pazpar2 response which changed
from 1.0.13 to 1.1.0.

15 years agoComma separated value for pz:recordfilter.
Adam Dickmeiss [Mon, 28 Sep 2009 10:16:48 +0000 (12:16 +0200)]
Comma separated value for pz:recordfilter.