Purchasing online journal access for a hospital medical library: how to identify value in commercially available products
© Carter et al; licensee BioMed Central Ltd. 2006
Received: 13 October 2004
Accepted: 12 July 2006
Published: 12 July 2006
Medical practice today requires evaluating large amounts of information which should be available at all times. This information is found most easily in a digital form. Some information has already been evaluated for validity (evidence based medicine sources) and some is in unevaluated form (paper and online journals). In order to improve access to digital information, the School of Clinical Medicine and Research at the University of the West Indies and Queen Elizabeth Hospital decided to enhance the library by offering online full text medical articles and evidence based medicine sources. The aim of this paper is to evaluate the relative value of online journal commercial products available for a small hospital and medical school library.
Three reference standards were chosen to represent the ideal list of core periodicals for a broad range of medical care: 2 Brandon/Hill selected lists of journals for the small medical library (BH and BH core) and the academic medical library core journal collection chosen for the Florida State University College of Medicine Medical Library. Six commercially available collections were compared to the reference standards and to the current paper journal subscription list as regards to number of journals matched and cost per journal matched. Ease of use and presence of secondary sources were also considered.
The cost per journal matched ranged from US $ 3194 to $ 81. Because of their low subscription prices, the Biomedical Reference Collection and Proquest products were the most cost beneficial. However, they provided low coverage of the ideal lists (12 – 17% and 21–32% respectively) and contained significant embargoes on current editions, were not user friendly and contained no secondary sources. The Ovid Brandon/Hill Plus Collection overcame these difficulties but had a much higher cost-benefit range while providing higher coverage of the ideal lists (14–47%).
After considering costs, benefits, ease of use, embargoes, presence of secondary sources (ACP Journal Club, DARE), the Ovid Brandon/Hill Plus Collection was the best choice for our hospital considering our budget. However, the option to individually select our own journal list from Ovid and pay per journal has a certain appeal as well.
Evidence based practice is the conscientious, explicit and judicious use of current best evidence in making decisions about the health care of individuals and groups. The process of evidence based practice involves creating a clinical question from a problem arising from the care of a patient, searching the literature for evidence to answer the question, appraising the evidence found and applying the evidence to the clinical problem . If evidence based practice is to be introduced into routine medical care in an acute care hospital, health care providers and students need immediate access to evidence 24 hours per day, 7 days per week. The traditional concept of a hospital medical library housing a limited collection of scholarly journals with a librarian who can send requests for interlibrary loan of articles not available locally is no longer sufficient. When a health care provider has a clinical question and performs an online search to find the evidence for the answer, the evidence may be found in any of the thousands of scholarly journals currently produced in the biomedical literature although certain "core" journals are more likely to be cited. And the information may well be needed at a time when the librarian is not available. In addition, the wait for an interlibrary loan may well exceed the time period in which health care decisions must be made. The solution to this problem is found in obtaining access to the full text of scholarly publications online.
Many subscriptions to collections of online scholarly publications are available. All are quite costly. Obtaining access to the thousands of biomedical journals currently published is not financially practical for a hospital library with a limited budget. Decision-makers must identify a collection of journals that are most likely to be cited that can be purchased within the library budget. They could benefit from a tool to assist with decision-making as to which of these online collections represents the best value for cost.
The Queen Elizabeth Hospital and the University of the West Indies School of Clinical Medicine and Research, Cave Hill Campus decided to implement increased awareness and use of evidence based practice techniques in the care of patients. It was decided that online access to scholarly journals and other sources of evidence was essential to this process. The two organizations share a building near Bridgetown, Barbados. They also share a library service that, at the time the decision was made to provide online access to journals, was providing traditional service of a limited number of subscriptions to journals stored on site and an interlibrary loan service. The hospital is a 600 bed facility with a budget of approximately US $ 70,000 for scholarly journal subscriptions. The UWI Cave Hill medical campus provides instruction for the final 2 years of undergraduate physician training and supports all phases of postgraduate training in most of the common specialties. The medical school had no specific budget for scholarly journals or other sources of evidence but was willing to start contributing to online information sources.
Three reference standards were chosen to represent the "ideal" list of core publications for a broad range of medical care: 1.) the widely recognized Brandon/Hill selected list of journals for the small medical library (BH), 2.) the BH special category of 60 journals considered the minimal core list  (BH Core) and 3.) the academic medical library core journal collection chosen for the Florida State University College of Medicine Medical Library [3, 4] (FSU). The former two are slanted to the needs of a community hospital and the latter to the needs of a medical school. FSU was chosen because it is a totally new medical school that is very oriented towards evidence based medicine. The lists focus primarily on journals published in the United States but contain journals from many other countries as well. It was also decided that, in addition to scholarly journals (primary sources), a number of sources of summaries of evidence (secondary sources) would be needed. It was decided not to purchase any online textbooks at this time. Commercial providers of online scholarly journals were identified and contacted. Each was asked to provide the list or lists of the journals they could provide and the costs of those lists. Each commercial list was compared to the two BH lists, the FSU list and the list of journals currently subscribed to by the hospital library for completeness. The number of journals on each commercial list that was also on each of the "ideal" core lists was compared with the price of the commercial list. Availability of secondary sources of evidence and ease of use was also considered.
Results and discussion
Characteristics of Products Evaluated
Name of List
Name of Provider available
Number of journal editions full text
Embargo on recent
Cost US $
Biomedical Reference Collection Comprehensive Edition
Yes up to 12 months
Proquest Research Library, Pharmaceutical News Index and Medical Library
Yes up to 12 months
Ovid Core Biomedical Collection
Ovid Technologies Inc
Ovid Lippincott Williams & Wilkins Brandon Hill Collection
Ovid Technologies Inc
Ovid Brandon/Hill Plus Collection
Ovid Technologies Inc
Ovid Brandon/Hill plus Hague Collection 1 and 11
Ovid Technologies Inc
Number & Price per Journal in the Reference Standards for Products Evaluated
Name of List (number of full text journals on list)
#1 Number (%) & price per journal of BH core 60 journals present on list (US $)
#2 Number (%) & price per journal of BH 141 journals present on list (US $)
#3 Number (%) and price per journal of FSU 449 journals present on list (US $)
#4 Number (%) and price per journal of Queen Elizabeth Hospital 208 Journal collection (US $)
A Biomedical Reference Collection Comprehensive Edition (550)
B Proquest Research Library, Pharmaceutical News Index and Medical Library (494)
C Ovid Core Biomedical Collection (15)
D Ovid Lippincott Williams and Wilkins Brandon Hill Collection (20)
E Ovid Brandon/Hill Plus Collection (66)
F Ovid Brandon/Hill plus Hague Collection l and ll (124)
The FSU list contains 449 journals (Table 2 #3). The BH list was almost completely subsumed in the FSU list with 136 of the 141 being on it and all of the BH Core being on it. The Queen Elizabeth Hospital library subscribed to 208 paper journals in 2003 (Table 2 #4).
The results of comparison of each journal list evaluated with the reference standards are presented in Table 2. The price per journal ranged from US $ 3194 for F (Ovid Brandon/Hill plus Hague I and II for journals on the #1 BH minimal core list) to a low of US $ 81 per journal for B (Proquest for journals on the #3 FSU list). The US $ 3194 per journal for F covered 52% of the #1 BH minimum core list. In contrast, the cost for E (Ovid BH Plus collection for journals on the #1 BH minimal core list) was US $ 1955 per journal and covered 47% of same collection.
Because of their low subscription prices, the Biomedical Reference Collection and Proquest lists were the most cost- beneficial per frequently used journal. However, they fell far short of the "ideal list". In addition, they contained significant embargoes on current editions and did not contain any secondary sources. Finally, they would not be as user friendly as the Ovid lists since there was no direct link between search result screens and the full text journal article. Despite the higher cost to benefit of the Ovid lists, the lack of embargoes, the availability of secondary sources and user friendly design made them more attractive. Ovid also would allow a library to select individual online journals rather than choosing a fixed list. Any online journals available from Ovid could be selected by our medical library and the cost would be the sum of the individual journals chosen.
Within the Ovid collections, the Ovid Brandon/Hill Plus collection and Ovid Brandon/Hill plus Hague Collection I and II provided high coverage of the "ideal" lists but were very expensive.
When considering the costs, benefits, ease of use, embargoes, presence of secondary sources, it was decided that the Ovid Brandon/Hill Plus Collection was the best choice for the Queen Elizabeth Hospital/University of the West Indies School of Clinical Medicine and Research Library facility. This fits within the budget available if paper journal subscriptions were to be cancelled. A second option would be to pick individual journals available from Ovid after surveying users.
An additional major financial consideration beyond the cost of the subscriptions considered here was the necessity for more computers and a higher bandwidth network for the library if paper subscriptions were to be cancelled.
The decision as to which commercial collection to purchase will be different for any other medical facility as needs and budgets differ and the contents and prices of the lists available change over time. However, the methods described here to arrive at a decision can be utilized by any facility.
- Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB: Evidence Based Medicine: How to Practice and Teach EBM. 2000, Churchill Livingstone, Harcourt Publishers Ltd., London, 2Google Scholar
- Hill DR, Stickell HN: Brandon/Hill selected list of print books and journals for the small medical library. Bull Med Libr Assoc. 2001, 89 (2): 131-153.PubMedPubMed CentralGoogle Scholar
- Shearer BS, Nagy SP: Developing an academic medical library core journal collection in the (almost) post-print era: the Florida State University College of Medicine Medical Library experience. J Med Libr Assoc. 2003, 91 (3): 292-302.PubMedPubMed CentralGoogle Scholar
- Florida State University College of Medicine Library. [http://med.fsu.edu/library/default.asp]
- Biomedical Reference Collection: Comprehensive Edition. [http://www.epnet.com/]
- Proquest homepage. [http://www.proquest.com]
- Ovid homepage. [http://www.ovid.com]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.