A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Google Scholar

Lokman I. Meho and Kiduk Yang
School of Library and Information Science, Indiana University, 2007


Academic institutions, federal agencies, publishers, editors, authors, and librarians increasingly rely on citation analysis for making hiring, promotion, tenure, funding, and/or reviewer and journal evaluation and selection decisions. The Institute for Scientific Information’s (ISI) citation databases have been used for decades as a starting point and often as the only tools for locating citations and/or conducting citation analyses. ISI databases (or Web of Science), however, may no longer be adequate as the only or even the main sources of citations because new databases and tools that allow citation searching are now available. Whether these new databases and tools complement or represent alternatives to Web of Science (WoS) is important to explore. Using a group of 15 library and information science faculty members as a case study, this paper examines the effects of using Scopus and Google Scholar (GS) on the citation counts and rankings of scholars as measured by WoS. The paper discusses the strengths and weaknesses of WoS, Scopus, and GS, their overlap and uniqueness, quality and language of the citations, and the implications of the findings for citation analysis. The project involved citation searching for approximately 1,100 scholarly works published by the study group and over 200 works by a test group (an additional 10 faculty members). Overall, more than 10,000 citing and purportedly citing documents were examined. WoS data took about 100 hours of collecting and processing time, Scopus consumed 200 hours, and GS a grueling 3,000 hours.

Conclusions by the authors:

The study found that the addition of Scopus citations to those of WoS could significantly alter the ranking of scholars. The study also found that GS stands out in its coverage of conference proceedings as well as international, non-English language journals, among others. GS also indexes a wide variety of document types, some of which may be of significant value to researchers. The use of Scopus and GS, in addition to WoS, reveals a more comprehensive and accurate picture of the extent of the scholarly relationship between LIS and other fields, as evidenced by the unique titles that cite LIS literature (e.g., titles from Cognitive Science, Computer Science, Education, and Engineering, to name only a few). Significantly, this study has demonstrated that:

  1. Although WoS remains an indispensable citation database, it should not be used alone for locating citations to an author or title, and, by extension, journals, departments, and countries; Scopus should be used concurrently.
  2. Although Scopus provides more comprehensive citation coverage of LIS and LIS-related literature than WoS for the period 1996-2005, the two databases complement rather than replace each other.
  3. While both Scopus and GS help identify a considerable number of citations not found in WoS, only Scopus significantly alters the ranking of scholars as measured by WoS.
    Although GS unique citations are not of the same quality as those found in WoS or Scopus, they could be very useful in showing evidence of broader international impact than could possibly be done through the two proprietary databases.
  4. GS value for citation searching purposes is severely diminished by its inherent problems. GS data are not limited to refereed, high quality journals and conference proceedings. GS is also very cumbersome to use and needs significant improvement in the way it displays search results and the downloading capabilities it offers for it to become a useful tool for large-scale citation analyses.
  5. Given the low overlap or high uniqueness between the three tools, they may all be necessary to develop more accurate maps or visualizations of scholarly networks and impact both within and between disciplines (Börner, Chen, & Boyack, 2003; Börner, Sanyal, & Vespignani, 2006; Small, 1999; White & McCain, 1997).
  6. Each database or tool requires specific search strategy(ies) in order to collect citation data, some more accurately and quickly (i.e., WoS and Scopus) than others (i.e., GS).

(Accepted for publication in the Journal of the American Society for Information Science and Technology)

About these ads

About Wilfred Mijnhardt
RMIMR is my virtual playground, a place to reflect on issues from my professional context; my job as Policy Director at Rotterdam School of Management, erasmus University (RSM) and Executive Director at Erasmus Research Institute of Management (ERIM). ERIM is the joint research Institute of the Rotterdam School of Management (RSM) and the Erasmus School of Economics (ESE) at the Erasmus University Rotterdam. www.erim.eur.nl www.rsm.nl www.ese.eur.nl Here is my list of relevant publications on the topic of my RMIMR weblog: http://www.mendeley.com/collections/694621/RMIMR-Repository/ The rss feed for my RMIMR collection is here: http://www.mendeley.com/collections/rss/694621/ Here is my other weblog on impact of research: http://www.scoop.it/t/dualimpact

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

RSS Business School News

  • Mena: Petite santé des business schools - L'Économiste April 24, 2014
    Mena: Petite santé des business schoolsL'ÉconomisteL'éthique, au coeur du débat de l'European Foundation for Management Development (EFMD) qui regroupe les plus grandes universités et business schools du monde et particulièrement d'Europe. Chaque année, ses membres se réunissent pour réfléchir ...
  • WUT Business School and CEU Business School Launch MBA Partnership - FIND MBA April 24, 2014
    WUT Business School and CEU Business School Launch MBA PartnershipFIND MBAPoland's Warsaw University of Technology Business School (WUT) has announced that beginning this September, it will offer its International MBA program in partnership with Hungary's Central European University Business School (CEU). With the new ...
  • Who Needs Business School? The Hidden Startup Resources At Your Local ... - Fast Company April 24, 2014
    Fast CompanyWho Needs Business School? The Hidden Startup Resources At Your Local ...Fast CompanyYou don't have to start from scratch: Sample business plans, examples of employee policies, and community databases with information on demographics are just some of the resources available for free at libraries. Researching the regional and national ...
  • Business school student fined for attack on course mate - Exepose April 24, 2014
    Business school student fined for attack on course mateExeposeA University of Exeter student has been fined £1,000 for attacking his course mate and destroying her computer. Business student Kaize Qin appeared in Exeter Magistrates court on January 12 and was charged with beating a female student and destroying ...
  • Business school essay service - The Grandstand Gazette (blog) April 24, 2014
    Business school essay serviceThe Grandstand Gazette (blog)One business school essay service understand members of the study of George? About balancing evidence in your writing Balancing evidence means that you will weave together information from different sources into your body paragraph. Learning to write ...
  • Business school essay writing service - The Grandstand Gazette (blog) April 24, 2014
    Business school essay writing serviceThe Grandstand Gazette (blog)After a fire starts in the Flanagans business school essay writing service, Theo About Leisureo Acquaintance With Birdso Against Talkingo Blame Of Portraits, we will revise it free of business school essay writing service within shortest possible timeline.
  • How Dubai's business school bubble burst - Times Higher Education April 23, 2014
    Times Higher EducationHow Dubai's business school bubble burstTimes Higher EducationThe expansion and then rapid collapse of business schools in Dubai over the period 2002 to 2012 “closely followed the classic progression of bubble formation and bursting” and as a result, the schools “made most of the mistakes” that are listed in ...
  • MUN business school launching graduate science degree - The Telegram April 23, 2014
    MUN business school launching graduate science degreeThe TelegramLooking for Telegram email addresses? Click here! Looking for Telegram email addresses? Click here! The Telegram>; News>; Local. MUN business school launching graduate science degree. Published on April 23, 2014. Share 0. 0 Comment; Send to a ...
  • Harvard Business School Scholarships Awarded to Outstanding New England ... - PR Newswire (press release) April 23, 2014
    Harvard Business School Scholarships Awarded to Outstanding New England ...PR Newswire (press release)PROVIDENCE, R.I., April 23, 2014 /PRNewswire-iReach/ -- The Harvard Business School Association of Southeastern New England (HBSA-SNE) awarded two scholarships this year to Joe O'Connor, General Manager of Rhode Island Public Radio, and to ...
  • Ross School of Business Wants A 200-Year-Old Oak to Make Like a Tree and ... - Businessweek April 23, 2014
    Ross School of Business Wants A 200-Year-Old Oak to Make Like a Tree and ...BusinessweekBusiness schools spare little expense to make their campuses sparkle for alumni, recruiters, and prospective students. For the University of Michigan's Ross School of Business, that means spending $300,000 to uproot a 65-foot-tall tree and transplant ...
Locations of Site Visitors

Get every new post delivered to your Inbox.

%d bloggers like this: