A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Google Scholar

Lokman I. Meho and Kiduk Yang
School of Library and Information Science, Indiana University, 2007


Academic institutions, federal agencies, publishers, editors, authors, and librarians increasingly rely on citation analysis for making hiring, promotion, tenure, funding, and/or reviewer and journal evaluation and selection decisions. The Institute for Scientific Information’s (ISI) citation databases have been used for decades as a starting point and often as the only tools for locating citations and/or conducting citation analyses. ISI databases (or Web of Science), however, may no longer be adequate as the only or even the main sources of citations because new databases and tools that allow citation searching are now available. Whether these new databases and tools complement or represent alternatives to Web of Science (WoS) is important to explore. Using a group of 15 library and information science faculty members as a case study, this paper examines the effects of using Scopus and Google Scholar (GS) on the citation counts and rankings of scholars as measured by WoS. The paper discusses the strengths and weaknesses of WoS, Scopus, and GS, their overlap and uniqueness, quality and language of the citations, and the implications of the findings for citation analysis. The project involved citation searching for approximately 1,100 scholarly works published by the study group and over 200 works by a test group (an additional 10 faculty members). Overall, more than 10,000 citing and purportedly citing documents were examined. WoS data took about 100 hours of collecting and processing time, Scopus consumed 200 hours, and GS a grueling 3,000 hours.

Conclusions by the authors:

The study found that the addition of Scopus citations to those of WoS could significantly alter the ranking of scholars. The study also found that GS stands out in its coverage of conference proceedings as well as international, non-English language journals, among others. GS also indexes a wide variety of document types, some of which may be of significant value to researchers. The use of Scopus and GS, in addition to WoS, reveals a more comprehensive and accurate picture of the extent of the scholarly relationship between LIS and other fields, as evidenced by the unique titles that cite LIS literature (e.g., titles from Cognitive Science, Computer Science, Education, and Engineering, to name only a few). Significantly, this study has demonstrated that:

  1. Although WoS remains an indispensable citation database, it should not be used alone for locating citations to an author or title, and, by extension, journals, departments, and countries; Scopus should be used concurrently.
  2. Although Scopus provides more comprehensive citation coverage of LIS and LIS-related literature than WoS for the period 1996-2005, the two databases complement rather than replace each other.
  3. While both Scopus and GS help identify a considerable number of citations not found in WoS, only Scopus significantly alters the ranking of scholars as measured by WoS.
    Although GS unique citations are not of the same quality as those found in WoS or Scopus, they could be very useful in showing evidence of broader international impact than could possibly be done through the two proprietary databases.
  4. GS value for citation searching purposes is severely diminished by its inherent problems. GS data are not limited to refereed, high quality journals and conference proceedings. GS is also very cumbersome to use and needs significant improvement in the way it displays search results and the downloading capabilities it offers for it to become a useful tool for large-scale citation analyses.
  5. Given the low overlap or high uniqueness between the three tools, they may all be necessary to develop more accurate maps or visualizations of scholarly networks and impact both within and between disciplines (Börner, Chen, & Boyack, 2003; Börner, Sanyal, & Vespignani, 2006; Small, 1999; White & McCain, 1997).
  6. Each database or tool requires specific search strategy(ies) in order to collect citation data, some more accurately and quickly (i.e., WoS and Scopus) than others (i.e., GS).

(Accepted for publication in the Journal of the American Society for Information Science and Technology)

About these ads

About Wilfred Mijnhardt
RMIMR is my virtual playground, a place to reflect on issues from my professional context, my job as Policy Director at Rotterdam School of Management, Erasmus University (RSM). RSM is the international university based business school at Erasmus University Rotterdam. More info here: www.rsm.nl Here is my list of relevant publications on the topic of my RMIMR weblog: http://www.mendeley.com/collections/694621/RMIMR-Repository/ The rss feed for my RMIMR collection is here: http://www.mendeley.com/collections/rss/694621/ Here is my other weblog on impact of research: http://www.scoop.it/t/dualimpact

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

RSS Business School News

  • MBAs Are More Satisfied at Wharton Than at Harvard Business School - Bloomberg March 31, 2015
    BloombergMBAs Are More Satisfied at Wharton Than at Harvard Business SchoolBloombergStudents at the University of Pennsylvania's Wharton School of Business are more satisfied with their education than are people at the Harvard Business School, according to Wharton. On Monday, the Wharton Journal, a campus newspaper, touted the results ...
  • Clark Atlanta University hires Texas Southern's business school dean as president - Atlanta Business Chronicle March 31, 2015
    Atlanta Business ChronicleClark Atlanta University hires Texas Southern's business school dean as presidentAtlanta Business ChronicleJohnson is currently dean of Texas Southern University's of Jesse H. Jones School of Business and will succeed Clark Atlanta's current President Carlton E. Brown, who will retire on June 30. Johnson will take his […]
  • 3 things you won't learn in business school that are critical for success - Business Insider March 31, 2015
    Business Insider3 things you won't learn in business school that are critical for successBusiness InsiderGraduate business schools provide students with critical skills in financial modeling, statistics, physics, strategic planning, accounting, leadership, and human relations, as well as routes to critical thinking and effective communication — among .. […]
  • UNC Kenan-Flagler Business School to offer capital markets program with ... - UNC News March 31, 2015
    UNC Kenan-Flagler Business School to offer capital markets program with ...UNC News“We are thrilled to partner with UNC Kenan-Flagler Business School on this exciting new program,” said Eric Chardoillet, CEO of FFI. “UNC Kenan-Flagler represents everything we look for in a business school partner: World-class academic resources, ...UNC Kenan-Flagler Business […]
  • We Shouldn't Romanticize Steve Jobs as a CEO - Huffington Post Canada March 31, 2015
    Huffington Post CanadaWe Shouldn't Romanticize Steve Jobs as a CEOHuffington Post CanadaWorking with Ivey Business School professor Mary Crossan, I made this point in two Apple case studies designed to evoke debate about models of strategy, organization and leadership. The A case looks at Apple from an analytic perspective, giving Jobs ...and more »
  • Can Business School Save a Company? - The Atlantic March 31, 2015
    The AtlanticCan Business School Save a Company?The AtlanticHe'd been to business school at Morehead State University in Kentucky, so was familiar with many of the concepts the group was learning both in online classes and in the two weeks he and the other business owners spent at Babson. In his cohort were ...
  • BU renames business school after record $50 million gift - Boston Globe (subscription) March 31, 2015
    BloombergBU renames business school after record $50 million giftBoston Globe (subscription)BU's School of Management was christened the Questrom School of Business following a short campus ceremony honoring Allen and Kelli Questrom. The money will endow 10 faculty chairs and enable the school to begin planning to build a new graduate ...Boston Universi […]
  • Lloyd honored by USD business school - Sioux Falls Argus Leader March 30, 2015
    Sioux Falls Argus LeaderLloyd honored by USD business schoolSioux Falls Argus LeaderCraig Lloyd, CEO of Lloyd Cos., was honored Friday with the excellence in economic development award from the University of South Dakota's Beacom School of Business. The award is given annually to a business or community leader for the recipient's role ...
  • Veterans find success in UNI's business school - Waterloo Cedar Falls Courier March 30, 2015
    Veterans find success in UNI's business schoolWaterloo Cedar Falls CourierCEDAR FALLS -- The University of Northern Iowa College of Business Administration has been selected for the Military Times Best for Vets: Business Schools 2015 rankings. It recognizes business schools for their commitment to providing opportunities for ...and more »
  • Imperial College London Business School and University of Cambridge qualify ... - decanter.com March 30, 2015
    decanter.comImperial College London Business School and University of Cambridge qualify ...decanter.comThe ICLBS and Cambridge teams fought off stiff competition from other top UK universities, including London School of Economics, University of Oxford and University of St Andrews, as well Denmark's Copenhagen Business School and HEC Lausanne from ...
Locations of Site Visitors

Get every new post delivered to your Inbox.

%d bloggers like this: