Z39.50 Implementers Group Meeting Stouffer Concourse Hotel St. Louis, Missouri June 4-5, 1990 Final Agenda 1. Name of this Group 2. Status Reports 3. Management of Changes, Protocol Changes 4. PICS Proforma Review and Adoption 5. Profile Review and Adoption 6. Document Numbering Scheme 7. Scheduling/Activation of Subcommittee 8. Network Layer Addressing 9. Diacritics and Alternate character Sets 10. Images, Graphics, Fonts, Large Data Objects 11. Z39.50 Over SNA LU6.2 12. Revisit Layering Over TCP/IP 13. Explain/Help 14. Document Identifiers 15. Add Number of Result Sets to Init Response PDU 16. Make Present a Separate Service 16a. Various Protocol Enhancements 17. Union Catalog Records 18. Search Values for Language in the Attribute Set 19. New Attributes 20. Extension to Retrieve a Set of Attribute Values 21. Stoplists 22. Review Attribute and Error Message Sets 23. Resource Control Request Records Standardization/ Registration 24. Testing and Implementation 25. Availability of Code (Code Sharing) 26. ACM SIGCOM 27. Changes to Protocol 28. Revisit ZIG 90-007 and Other Issues 1. Name of the Group The name of the group will be the "Z39.50 Implementers Group". 2. Status Reports (Highlights) Florida Center for Library Automation They will be acquiring the IBM OSI/CS product before the end of June. They are now reading the manuals. Detailed design will follow. University of California/Penn State University In the design phase of their joint project. Coding will begin soon Penn State is converting from a proprietary protocol. University of California, Berkeley They are working with Thinking Machines on full-text retrieval project. It is anticipated that coding will be completed by the end of summer (1990) of full-text search and retrieval over TCP/IP (a crude implementation). OCLC OCLC is going to send a copy of their Z39.50 software to the National Library of Canada (in approximately 6 months), the University of California, and Penn State. Ralph stated that their Z39.50 implementation (a Z39.50 variant) would be available for testing (as a Target) by the 4th quarter of 1990 (over OSI stack). They hope to also be available for testing with their TCP/IP stack at the same time. Thinking Machines They have a working subset of Z39.50 on a Mac, talking to a local server. They are working on a TCP/IP connection to a Connection Machine. Their code is available; part is pure Z39.50; part is for Type 3 query. They have not described in ASN.1. They have used the User Information field for their extensions. Virginia Tech In design stage. In 30-45 days working model will be completed at high level. Carnegie-Mellon Running on Unix servers and clients under the Motif interface, using OCLC software and OCLC query. National Library of Canada Doing feasibility study with UTLAS, which will be completed in July. Results will be made available to the Z39.50 Implementers Group. They will be receiving Z39.50 software from Canada in approximately 6 months. UTLAS Will implement Z39.50 as a Target only. They are not planning to implement as an Origin (at least not for now). NOTIS They are planning to implement a "Z39.50 entry way" during the next two years. For now, they will be controlling both sides of the communication (i.e., Origin and Target, a NOTIS-to-NOTIS link) over TCP/IP. Most of the participants stated that they should have something implemented in 12-24 months. Lennie Stovel mentioned that LITA (at ALA) would be discussing Z39.50 implementations and the Internet. (June 25, 1990, 9:00-11:00) 6. Document Numbering Scheme Documents will be numbered as follows: ZIG 90-001 Documents containing descriptions of implemented variances to the protocol will be numbered as follows: ZIGE-1 ("E" as in experimental"). Documents will be available electronically. (Thinking Machines will set this up). Instructions on how to access these documents will be posted to Z39.50 email network. Mark Hinnebusch will assign both types of numbers. 4. PICS Proforma Review Dennis Mackinnon had a number of comments (see ZIG 90-008) as did others. The group went through the document page by page. Changes are noted below. The Z39.50 maintenance agency (LC) will act as editor of the proforma. Section 6.1: Note what version 2 is likely to include (changes to make Z39.50 compatible with ISO Search and Retrieve standards). Section 6.2: It was proposed that we drop "Types 2 and 3" and state "Other types". Section 6.4: Suggested listing other syntaxes. Dennis will supply text. Section 6.6: Change "Pro" column to "o". USMARC is not mandatory. Section 6.7: "Appendix D" will be replaced SR equivalent. Ralph is going to head an interest group on diagnostic codes, and will collect suggested additions to the list. Lennie proposed adding a number of the "S3" variants as separate diagnostics. Additions will be sent to Ralph and he will edit and send on to Ray. We agreed that we should not form subgroups. Rather we should take care of interest group topics by sharing ideas in the network. The interest groups will each have a discussion "provoker". For example, Ralph will provoke diagnostics discussion, etc. Section 7.1.1: Change "Pro" column to "ns" for both Max- message and Max record size. Add an item for "Query size" as "ns". Section 7.1.2: The values "F" and "B" are also possible in the "Simple form" therefore, revise text to clarify this point. Section 7.2: Change "Pro" column to "o" for Delete, Access- Cntrl-Resp, and Rsrc-Cntrl-Resp. Ray will fill out PDUs for Delete, Access Control, and Resource Control in PICS. Section 7.3.3: Change "Pro" column to "o" for MedStElemSetNms and PrefSyntax. Section 7.3.3.1: Change "Pro column to "o" for named resultSetName xmitted Section 7.3.3.2: In "Pro" column change "n's" to "o's". Section 7.3.5: Change "n" to "o" for PrefRecSyntax. Section 7.3.7: "Pro" column = "o", "m", "o". Section 7.3.13: Section was suggested to contain "constraints on User Info Field". After discussion, it was felt that a better place was in the Init APDU and in the Init Response. In Origin Transmission of Init, this would be expressed as "uses" of user information field. In Origin Receipt of Init Response, this would be expressed as "constraints" on user information field. Section 8.1.1: Change "Pro" column values to "ns". Section 8.1.2: And "Other" values of ElementSetNames. Section 8.2: Change "Pro" column to "o" for Delete, Access-Ctrl- Resp and Rsrc-Cntrl-Resp. Section 8.3.3.1: Change "Pro" column values to "ns". Section 8.3.3.2: Change "Std" column and "Pro" column as follows: Std Pro named resultSetNames supported o o max concurrent result sets ns ns result sets not unilaterally o o Section 8.3.3.3: Change "Pro" column values from "na" to "o". Section 8.3.3.4: Add "Other". Section 8.3.4.1: Change "Pro" column values to "ns". Add two new sections for Vendor Notes and for Site-specific Information Ray will make changes and distribute via electronic mail. 5. Profile Document (ZIG 90-001) Review There was some discussion about a possible extension to the standard. There was interest (Dennis MacKinnon) in having Target transmit end-of-session information when session is terminated. This information would include resource control type information. Ralph LeVan stated that he would rather have information at any time, not just at end of session. Section 8.6: Delete. Considered redundant. Document adopted as edited. 3. Management of Profile Changes, Protocol Changes There is a desire to "fix" a "Version 2" in time and distributing it, so that implementations can talk to each other. This would perhaps include some of the changes that the group wants. After discussion it was agreed that some "experimental" implementations would precede the standard. They should be distributed (posted) as ZIGEs. The FTP server would be the holder of the "experimental" description. Consider Option bit assignments (additional "experimental" ones) to be temporary. The maintenance agency will coordinate the bit assignments. There is a desire to add some attributes to the Bib-1 list. 9. Diacritics and Alternate Character Sets 10. a. b. and c. Images, graphics, fonts 11. Z39.50 over SNA LU6.2 Mark requested that these be removed from the agenda (since they were his suggestions, and time was in short supply). Nobody objected. 7. Standing Committees We agreed that we should not form subgroups. Interest group topics would be discussed by sharing ideas in the general Z39.50 network. The interest groups will each have a discussion "provoker". I. Diagnostics (additional) -- Ralph Levan (OCLC) II. Database Records (e.g., bibliographic, holdings, circulation, text files, etc.) This "interest group" will be in two parts: 1. Every type of record except full-text -- Mark Hinnebusch (Florida) 2. Full-text -- Franklin Davis (Thinking Machines) III. Large data objects -- Clifford Lynch (UC) (ZIG 90- 007) IV. Additional search attributes -- Clifford Lynch V. ASN.1 and bib records -- Ralph Levan 8. Network Layer Addressing Ray distributed ZIG 90-006, an extract from a GOSIP document, and explained the concept. No significant discussion. 10.d. Large Data Objects Carnegie-Mellon must transfer several megabytes of data in one record (graphic data). If transferred as one record, they have been having performance problems on busy network (TCP level errors, e.g., having segments retransmitted, throwing packets away, etc.). They wanted flow control at Applications Layer. Now, they use Maximum-message size as indicator. In addition, they are using element set name in "creative" ways. Clifford Lynch distributed ZIG 90-007. He will be the provoker of ZIG 90- 007-related discussion. It was suggested that the Help/Explain could be used to communicate some of this information. Discussion will continue via email with ZIG 90-007 as starting point. 12. Revisit Layering Over TCP/IP Should Transport Class O be inserted between Session and TCP/IP (a general proposal--RFC 1006--in Internet)? It was decided that there was no advantage to adding TPO under OSI Session, Presentation, and Application. Clifford Lynch will reconfirm this on the listserv. 13. Explain/help Service ZIG 90-009, describing extensions to SR to support an Explain service, was distributed by Clifford Lynch. Clifford wants feedback on the document. (Possible expansion, etc.) 14. Document Identifiers This item was suggested by email from Brewster Kahle. We will continue discussion on electronic mail. 15. Add Number of Result Sets in Init Response PDU It will be recommended to maintenance agency that a field be added to the Init PDU that specifies the number of result sets supported by Target. When is a Target considered stateless? When zero result sets are saved and Present is not supported. The majority of those present felt that it should be possible to not support Present Service. Franklin Davis (with some help from his friends) will prepare a case for a protocol change making it possible to have stateless machines and submit it to maintenance agency. It was agreed that the Init Response was the best place for this information. Many want to be able to state that their system cannot guarantee that any result sets will be saved (i.e., a value equal to "indeterminate" or unknown). It was proposed that this could be assumed if the element value was not included. This will require new text on page 9 of Z39.50 (conformance). There are two issues: 1. Protocol mechanism needed for statelessness 2. The conformance issue Franklin will put together a ZIGE (ZIGE 1) and distribute (post) it. 16. Make Present a Separate Service Present is currently defined as a separately-supportable service. 16.a. Various Protocol Enhancements Thinking Machines' Type 3/Relevance Feedback query (related works as search terms). Two types: 1. Related works as search team (document ID included in search term) 2. Keywords are weighted term present in the text of the document, but are NOT specified in search term. It was suggested that to include an attributes be added,if possible, to type 1 query to cover these requirements. Franklin will prepare zige 2 -- Attribute Extensions needed for Relevance Feedback Query (and other attribute extension). OCLC would like to include an attribute for browse. It was stated that TC46 folks have been assigned to work on this. when a draft comes out of TC46, it will be distributed (as a ZIG). OCLC would like to be able to request a "human formatted record" (meaning non-USMARC, only understood by a human being, not a machine). This record would be a printable string that would be displayed as received. It was suggested that record could be described as printable string with understanding that each occurrence is displayed as a separate line (a temporary format type). These would be used if Origin system cannot process Target system record. Some present suggested that a value be added to indicate preferred record syntax. Dennis will see whether ODA (Office Document Architecture) documentation provides any help. 17. Union Catalog Records Clifford stated that he was simply interested in hearing what type of records libraries were going to be putting in the results sets. Lennie stated that RLIN was NOT going to send primary cluster record only, but will send the entire cluster. The holdings will be embedded in each record. It was suggested that the database name be used to select primary cluster members only. Ralph (OCLC) stated that their holding database was separate. If searching OCLC, holdings for a particular record "AND OCLC_Holdings_Database" (i.e. , include database_name for the holding file). DLA is considering whether to provide separate records for each holding unit, or a base record, with or without embedded holdings. FCLA will be sending separate records. This discussion will be continued in electronic mail. 18. Search Values for Language Clifford stated that some systems do not use the USMARC language codes. However, after discussion, it was thought that most systems would carry the USMARC language codes in the 008 field. When an external list is used (e.g., USMARC Language Codes), this information should generally available. Possibly there should be a search attribute that refers to a specific list. 19. New Search Attributes What is the "scope" of Bib-1 attribute list? Is there a statement? What does bibliographic database mean? Can Bib-1 be used to search other database types? See also the Software Kinetics comments in ZIG 90-008. OCLC is interested in doing Patent Database searches using Bib-1 attributes, but they feel that they would need to add "inventor", which they feel is different from "personal name". Thinking Machines' attributes could be added (e.g., "score or "relevance", i.e., how well did the document match the query). Discussion will continue over electronic mail. Clifford Lynch will be the provoker. There was some discussion on the topic of brief records. Dennis MacKinnon does not want brief records to be transferred in USMARC, but wants to use another transfer syntax. He said that he would be distributing a description of the brief record they wish to use in ILL as an example. 24. Testing OCLC -- Ready during 4th quarter of 1990 (OSI stack) Hope to be ready with TCP/IP by 4th quarter as well. Version = variant of Z39.50. Thinking Machine -- End of summer (TCP/IP). Version = Z39.50 (not using ASN.1 initially). Carnegie-Mellon -- End of year (TCP/IP). Penn State/Univ. of Calif--lst quarter of next year (TCP/IP). UC Berkeley -- End of summer TCP/IP). 25. Code Sharing Thinking Machines' file server will be the repository for sharable source code. NEXT MEETING The next meeting will be in Washington, D.C. The meeting following that will be on the West Coast. The date of the next meeting was tentatively set for September 13 and 14 (Thursday and Friday). ZIG Document List ZIG 90-001 Application Profile for Z39.60. March 1990. (First Draft) ZIG 90-002 Profile PICS Proforma for Z39.50. March 1990. (First Draft) ZIG 90-003 Z39.50 Maintenance Agency Terms of Reference and Procedures. November 1989. ZIG 90-004 Documentation - Search and Retrieve Service Definition. ISO/DIS 10163. ZIG 90-005 Documentation - Search and Retrieve Protocol Specification. ISO/DIS 10163. ZIG 90-006 5. Addressing Requirements. ›Extract from GOSIP documentation| ZIG 90-007 Image and Full-text transfer under Z39.50 -- issues for discussion ›Clifford A. Lynch, June 1990| ZIG 90-008 Contributions on: Z39.50 PICS Proforma, Agenda Items, Stop Words, Z39.50 Profile, Attributes. D. MacKinnon and J. Zeeman, Software Kinetics Ltd. June 1990. ›5 documents| ZIG 90-009 Extensions to ISO DP 10162/10163 to Support an Explain Service Clifford A. Lynch, December 9, 1989. Attendees: Margaret Baker, UC Berkeley Ralph Levan, OCLC Jean-Eudes Beriault, NLC Clifford Lynch, UC DLA Franklin Davis, Thinking Machines Dennis MacKinnon, Software Kinetics Ray Denenberg, LC Jim Michael, DRA Larry Dixson, LC Bill Mooney, UTLAS Sean Donelan, DRA Mark Needleman, UC DLA Tom Dopirak, Carnegie-Mellon Sara Randall, NOTIS Eric Ferrin, Penn State Curtis Shields, Virginia Tech Bob Fleischer, DEC Lennie Stovel, RLG Mark Hinnebusch, FCLA Randy Williams, DRA John Kunze, UC Berkeley Notes prepared by Larry Dixson and edited by Lennie Stovel.