Adam Dickmeiss [Tue, 3 Nov 2009 14:03:41 +0000 (15:03 +0100)]
Modify length calculation for ranking
Use a different denominator (length) for per-field relevance
scoring.. Instead of length of all ranked fields we now use
length of individual fields (as if they were individual "free" text
fields). This will ensure that documents with a long field with no
match (say description) will not "hurt" a title match.
Adam Dickmeiss [Tue, 3 Nov 2009 12:15:27 +0000 (13:15 +0100)]
Remove dead code for relevancy (trie stuff)
Adam Dickmeiss [Fri, 30 Oct 2009 21:45:28 +0000 (22:45 +0100)]
Fix bytarget requests being stopped (bug #3087)
Context global activeClients is set to 1 when a search is initiated
to ensure that if bytarget is executed it will be continued if
no response has been returned which would set activeClients (show,
stat).
Adam Dickmeiss [Tue, 27 Oct 2009 08:25:28 +0000 (09:25 +0100)]
Update test result for new mergekey (marcmap)
Jason Skomorowski [Tue, 27 Oct 2009 02:40:49 +0000 (22:40 -0400)]
marcmap mergekey missed author.
Adam Dickmeiss [Mon, 26 Oct 2009 16:00:57 +0000 (17:00 +0100)]
Test return error if curl is not found
Adam Dickmeiss [Mon, 26 Oct 2009 09:20:49 +0000 (10:20 +0100)]
Update test results for diagnostic code
Sebastian Hammer [Fri, 23 Oct 2009 18:40:03 +0000 (18:40 +0000)]
Diagnostic member was not set on connection error. Fixed
Adam Dickmeiss [Tue, 20 Oct 2009 11:54:07 +0000 (13:54 +0200)]
New setting: pz:pqf_strftime
This setting does all what pqf_prefix does but more. It uses strftime
conversions and reserves %% for the original PQF.
Adam Dickmeiss [Tue, 20 Oct 2009 11:05:42 +0000 (13:05 +0200)]
Add test for custom attribute (description@tag)
Adam Dickmeiss [Tue, 20 Oct 2009 10:52:16 +0000 (12:52 +0200)]
Preserve pz:metadata attributes
Pazpar2 now preserves pz:metadata attributes for non-merged
elements. This allows custom attributes to be passed through
to a user interface from records.
Adam Dickmeiss [Tue, 20 Oct 2009 10:32:28 +0000 (12:32 +0200)]
Const value for record_metadata_init
Adam Dickmeiss [Tue, 20 Oct 2009 10:02:57 +0000 (12:02 +0200)]
Fix double xmlFree - occurred for XSLT failure
Adam Dickmeiss [Mon, 19 Oct 2009 14:50:57 +0000 (16:50 +0200)]
Fix Host header for SRU/SRW - bug #3069
Adam Dickmeiss [Fri, 16 Oct 2009 21:57:54 +0000 (23:57 +0200)]
Fix update settings for wildcard zurls
Adam Dickmeiss [Thu, 15 Oct 2009 10:12:44 +0000 (12:12 +0200)]
Refactor database code
Filter handling now in database.c.
Adam Dickmeiss [Thu, 15 Oct 2009 08:37:03 +0000 (10:37 +0200)]
Addd test case for per-session setting
Adam Dickmeiss [Thu, 15 Oct 2009 07:59:05 +0000 (09:59 +0200)]
Sessions may be added per-session.
Settings system refactoring which allows settings to be defined
per-session (session_database and database).
Adam Dickmeiss [Thu, 15 Oct 2009 07:58:07 +0000 (09:58 +0200)]
Use PAZPAR2_USE_VALGRIND for test
If PAZPAR2_USE_VALGRIND=true, valgrind will be used for a test, eg
PAZPAR2_USE_VALGRIND=true ./test_http.sh .
Adam Dickmeiss [Wed, 14 Oct 2009 14:32:24 +0000 (16:32 +0200)]
Test case for setting overrides
Adam Dickmeiss [Wed, 14 Oct 2009 14:29:36 +0000 (16:29 +0200)]
Settings, bytarget + db out-of-range check
Command bytarget with argument settings=1 will show settings
per target.. This is to be able to verify correct settings and
be able to test that they are correct. The database settings
array size is now also stored.. Problems with database settings
array is that if not carefull it will be too small (smaller
than dictionary per-service in settings).
Adam Dickmeiss [Wed, 14 Oct 2009 14:27:48 +0000 (16:27 +0200)]
Fix nasty bug of overrides not working
Adam Dickmeiss [Tue, 13 Oct 2009 13:55:46 +0000 (15:55 +0200)]
Deal with relevance values round-off case
Adam Dickmeiss [Tue, 13 Oct 2009 13:54:11 +0000 (15:54 +0200)]
Sometimes it takes 2 sec for Pazpar2 to stop
Adam Dickmeiss [Tue, 13 Oct 2009 11:48:58 +0000 (13:48 +0200)]
Make reclist sorting stable
Make reclist sorting stable by comparing mergekey for records if
relevance/title or other sorting criteria all match. This is merely
to ensure that our regressions tests works (reproducible output).
Adam Dickmeiss [Tue, 13 Oct 2009 11:28:50 +0000 (13:28 +0200)]
Dont include start,number for show tests
Adam Dickmeiss [Tue, 13 Oct 2009 11:13:05 +0000 (13:13 +0200)]
Reformat
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:52 +0000 (13:03 +0200)]
Fix type of mergekey
Adam Dickmeiss [Tue, 13 Oct 2009 11:03:34 +0000 (13:03 +0200)]
Update to host website
Adam Dickmeiss [Tue, 13 Oct 2009 09:24:14 +0000 (11:24 +0200)]
Version 1.2.2
Adam Dickmeiss [Tue, 13 Oct 2009 09:21:26 +0000 (11:21 +0200)]
Describe filter,maxrecs,startrecs
Adam Dickmeiss [Tue, 13 Oct 2009 09:20:39 +0000 (11:20 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 13 Oct 2009 09:19:15 +0000 (11:19 +0200)]
Operator for pz:recordfilter is ~ (tilde).
The operator used to be = (equals), but since pz:recordfilter only
does substring match it seems more natural to harmonize with the
filter semantics (which has ~ for substring, = for string match).
Adam Dickmeiss [Tue, 13 Oct 2009 09:18:36 +0000 (11:18 +0200)]
Describe pz:recordfilter
Adam Dickmeiss [Tue, 13 Oct 2009 09:14:13 +0000 (11:14 +0200)]
Reformat
Adam Dickmeiss [Mon, 12 Oct 2009 20:32:52 +0000 (22:32 +0200)]
Set ZOOM option start always for 0-case.
For maxrecs=0 or maxrecs omitted, set ZOOM option "start".
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:35 +0000 (16:21 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Mon, 12 Oct 2009 14:21:19 +0000 (16:21 +0200)]
New optional argument, startrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 14:15:15 +0000 (16:15 +0200)]
Enable apdulog for test server
Heikki Levanto [Mon, 12 Oct 2009 11:59:09 +0000 (13:59 +0200)]
Added two new fields
856$i gets into electronic-format-instruction
856$q gets into electronic-fortmat-type
Needed for LOT
Adam Dickmeiss [Mon, 12 Oct 2009 10:22:40 +0000 (12:22 +0200)]
New optional argument, maxrecs, for cmd=search
Adam Dickmeiss [Mon, 12 Oct 2009 08:29:56 +0000 (10:29 +0200)]
Make Pazpar2 work on Libxml2 2.4
Adam Dickmeiss [Sat, 10 Oct 2009 20:18:27 +0000 (22:18 +0200)]
Use curl for tests. No wget.
Search for curl in PATH and run test if present. wget is no longer used -
because it does not return "empty" result if HTTP server returns error
(e.g 417) - and because wget on older systems don't work with Pazpar2
at all.
Adam Dickmeiss [Fri, 9 Oct 2009 18:13:11 +0000 (20:13 +0200)]
Add test for pz:maxrecs
Adam Dickmeiss [Fri, 9 Oct 2009 18:11:50 +0000 (20:11 +0200)]
Adjust presentChunk for low value of pz:maxrecs
Set presentChunk to pz:maxrecs if that is lower than 20 (default value
of presentChunk).
Adam Dickmeiss [Fri, 9 Oct 2009 14:41:45 +0000 (16:41 +0200)]
Merge branch 'reclist_max_recs'
Adam Dickmeiss [Fri, 9 Oct 2009 14:26:54 +0000 (16:26 +0200)]
Fix dump_records for cluster==0
Adam Dickmeiss [Fri, 9 Oct 2009 13:14:41 +0000 (15:14 +0200)]
Fixed size hash for some structures.
Fixed size hash lists for termlists, reclists.. Remove global variable
parameters.toget.
Adam Dickmeiss [Fri, 9 Oct 2009 12:32:47 +0000 (14:32 +0200)]
Update sample cclmap for SRU test server
The cclmap settings now use the string use-attribute which is the
name of the CCL search field. This config uses cql_transform_rpn2cql
without the need for pqf.properties. See also bug #2978.
Adam Dickmeiss [Fri, 9 Oct 2009 12:31:58 +0000 (14:31 +0200)]
Log more for PQF to CQL conversion
Adam Dickmeiss [Thu, 8 Oct 2009 20:32:14 +0000 (22:32 +0200)]
Preserve order for insertion in reclist
Preserve for reclist insertion so that tests give same result.
Before this commit, results were correct but sorting would be
different for identical sortkeys (unstable sort).
Adam Dickmeiss [Thu, 8 Oct 2009 13:56:18 +0000 (15:56 +0200)]
Reclists work.
Adam Dickmeiss [Thu, 8 Oct 2009 13:01:18 +0000 (15:01 +0200)]
Remove unused code
Adam Dickmeiss [Thu, 8 Oct 2009 12:52:34 +0000 (14:52 +0200)]
Refactor: hide reclist structure
Adam Dickmeiss [Thu, 8 Oct 2009 10:47:48 +0000 (12:47 +0200)]
Substring for all setting types.
Change match_criterion so that substring (~) match uses strstr
always. The equal/string (=) uses match_zurl magic and strcmp as
before. This also ensure that v ptr is always set at end of routine
to prevent undefined behavior.
Adam Dickmeiss [Thu, 8 Oct 2009 10:39:34 +0000 (12:39 +0200)]
Two searches with filter args
Adam Dickmeiss [Thu, 8 Oct 2009 10:38:09 +0000 (12:38 +0200)]
Simplify again
Adam Dickmeiss [Thu, 8 Oct 2009 10:35:20 +0000 (12:35 +0200)]
Update test for other filter parsing
Adam Dickmeiss [Thu, 8 Oct 2009 10:33:06 +0000 (12:33 +0200)]
parse_filter: spelling and more readable
Adam Dickmeiss [Thu, 8 Oct 2009 10:28:54 +0000 (12:28 +0200)]
Fix filters parsing
Fix the filter parsing so that equal name=value is working again.
In parse_filter, the eq would be set to NULL after finding '='.
Adam Dickmeiss [Thu, 8 Oct 2009 07:57:42 +0000 (09:57 +0200)]
Update for relevence element in results
Sebastian Hammer [Wed, 7 Oct 2009 14:55:59 +0000 (16:55 +0200)]
Added check for no transform steps
Sebastian Hammer [Wed, 7 Oct 2009 14:08:01 +0000 (14:08 +0000)]
Merge branch 'master' of ssh://git/home/git/pub/pazpar2
Sebastian Hammer [Wed, 7 Oct 2009 14:07:49 +0000 (14:07 +0000)]
Added relevance to return rec
Adam Dickmeiss [Wed, 7 Oct 2009 13:37:20 +0000 (15:37 +0200)]
Share similar XSLTs within session.
XSLTs + MARC maps are cached within a session so we don't re-parse
them over and over again. Even for a session with a single search
there's much to be gained because many targets use the same
transformation.
Adam Dickmeiss [Wed, 7 Oct 2009 12:56:39 +0000 (14:56 +0200)]
record_to_xml, normalize_record static
Adam Dickmeiss [Wed, 7 Oct 2009 12:35:41 +0000 (14:35 +0200)]
Other behavior misconfigured targets bug #2242
Pazpar2 will no longer return errors for individual targets .. such
as unknown stylesheets.. It will still be reported in the Pazpar2 log.
If all targets cannot be configured, it will return 'No targets'.
Adam Dickmeiss [Wed, 7 Oct 2009 12:19:14 +0000 (14:19 +0200)]
Factor out record normalization
Adam Dickmeiss [Wed, 7 Oct 2009 10:27:10 +0000 (12:27 +0200)]
Mergekey changes - order + required/optional.
The metadata attribute 'mergekey' now takes one of three values 'no',
'required', 'optional' . And the resulting mergekey from metadata
is now ordered in the same way as metadata in the service definition.
Older Pazpar2 version use the order in which metadata appeared in a
record instance.
Adam Dickmeiss [Wed, 7 Oct 2009 08:50:09 +0000 (10:50 +0200)]
Revert -V desc to be correct
Adam Dickmeiss [Wed, 7 Oct 2009 08:49:14 +0000 (10:49 +0200)]
Extra parantheses to make GCC happy
Adam Dickmeiss [Wed, 7 Oct 2009 08:39:00 +0000 (10:39 +0200)]
Show option -v in usage
Adam Dickmeiss [Wed, 7 Oct 2009 08:31:08 +0000 (10:31 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Wed, 7 Oct 2009 08:30:11 +0000 (10:30 +0200)]
Log level may be set (option -v)
Jason Skomorowski [Tue, 6 Oct 2009 16:13:44 +0000 (12:13 -0400)]
Substring matching for target selectiion.
Adam Dickmeiss [Mon, 5 Oct 2009 07:49:20 +0000 (09:49 +0200)]
Version 1.2.1
Adam Dickmeiss [Fri, 2 Oct 2009 20:50:02 +0000 (22:50 +0200)]
Move sleep till after kill in test
Adam Dickmeiss [Fri, 2 Oct 2009 20:33:43 +0000 (22:33 +0200)]
Use curl or wget for URL tests
Adam Dickmeiss [Fri, 2 Oct 2009 20:32:20 +0000 (22:32 +0200)]
URL encode [] to make curl happy
Adam Dickmeiss [Thu, 1 Oct 2009 19:58:36 +0000 (21:58 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Thu, 1 Oct 2009 19:51:11 +0000 (21:51 +0200)]
Configure checks for netlibs (-lnsl, -lsocket).
This should allow Pazpar2 to use getaddrinfo on Solaris.
Adam Dickmeiss [Thu, 1 Oct 2009 19:45:52 +0000 (21:45 +0200)]
Do not use gethostbyname in threaded resolver
Only use threaded resolver when getaddrinfo is found by configure.
Adam Dickmeiss [Thu, 1 Oct 2009 07:25:40 +0000 (09:25 +0200)]
Update NEWS WRT XML header
Adam Dickmeiss [Tue, 29 Sep 2009 21:20:25 +0000 (23:20 +0200)]
Update test due to XML header output.
Jason Skomorowski [Tue, 29 Sep 2009 19:49:56 +0000 (15:49 -0400)]
XML declaration added to command output.
Bug #3051
Jason Skomorowski [Tue, 29 Sep 2009 18:56:44 +0000 (14:56 -0400)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 29 Sep 2009 13:46:01 +0000 (15:46 +0200)]
Same fname scheme for mmap+xslt
Adam Dickmeiss [Tue, 29 Sep 2009 13:45:12 +0000 (15:45 +0200)]
Is retired. Really.
Adam Dickmeiss [Tue, 29 Sep 2009 13:20:15 +0000 (15:20 +0200)]
Change proto to use const char ptr
Adam Dickmeiss [Tue, 29 Sep 2009 11:38:51 +0000 (13:38 +0200)]
Fix timeout setting to use operation
Adam Dickmeiss [Tue, 29 Sep 2009 09:18:34 +0000 (11:18 +0200)]
Different approach to selecting medium.
Instead of substring-after/substring-before, just remove "white-space"
chars - such as "[]/ " . At least one target has been seen to use / in
245$h.
Adam Dickmeiss [Tue, 29 Sep 2009 08:23:56 +0000 (10:23 +0200)]
Log SHA1 version on start
Adam Dickmeiss [Tue, 29 Sep 2009 07:48:22 +0000 (09:48 +0200)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/pazpar2
Adam Dickmeiss [Tue, 29 Sep 2009 07:46:11 +0000 (09:46 +0200)]
Introduce Z39.50/SRU operation timeout.
Introduce operations timeout. It replaces connect timeout and is the
maximum waiting time before giving up an active operation. Its
default value is 30 seconds.
Adam Dickmeiss [Mon, 28 Sep 2009 21:46:26 +0000 (23:46 +0200)]
Fix for non-threaded resolver.
For the non-threaded host resolver, create_host may return NULL. This
in turn will make database-host a NULL ptr. This fixes
client_prep_connection to return if that's the case.
Adam Dickmeiss [Mon, 28 Sep 2009 18:36:42 +0000 (20:36 +0200)]
Update for different -V output
Pazpar2 -V now shows icu:enabled if ICU is enabled.
Adam Dickmeiss [Mon, 28 Sep 2009 18:18:50 +0000 (20:18 +0200)]
pz:recordfilter form is name[=substring].
pz:recordfilter is now of the form name[=substring]. A record is
included if metadata element is present and existing (substring
omitted) or includes substring (substring included).
Adam Dickmeiss [Mon, 28 Sep 2009 11:56:27 +0000 (13:56 +0200)]
Mergekey from XSL overrides mergekey=yes.
If mergekey attribute is present in XSL (px:xslt), then value for that
is used (and value of elements defined in metadata mergekey=yes are not
used). OIf mergekey is not present, then value of metadata mergekey=yes
elements are used. An empty value mergekey from XSL will generate
a unique mergekey.
Adam Dickmeiss [Mon, 28 Sep 2009 11:22:19 +0000 (13:22 +0200)]
JS: Use generic array for stats data.
The stat response data is now stored in an array based on element names.
This allow us to not keep in "sync" with the Pazpar2 response which changed
from 1.0.13 to 1.1.0.
Adam Dickmeiss [Mon, 28 Sep 2009 10:16:48 +0000 (12:16 +0200)]
Comma separated value for pz:recordfilter.