A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Google Scholar

Lokman I. Meho and Kiduk Yang
School of Library and Information Science, Indiana University, 2007


Academic institutions, federal agencies, publishers, editors, authors, and librarians increasingly rely on citation analysis for making hiring, promotion, tenure, funding, and/or reviewer and journal evaluation and selection decisions. The Institute for Scientific Information’s (ISI) citation databases have been used for decades as a starting point and often as the only tools for locating citations and/or conducting citation analyses. ISI databases (or Web of Science), however, may no longer be adequate as the only or even the main sources of citations because new databases and tools that allow citation searching are now available. Whether these new databases and tools complement or represent alternatives to Web of Science (WoS) is important to explore. Using a group of 15 library and information science faculty members as a case study, this paper examines the effects of using Scopus and Google Scholar (GS) on the citation counts and rankings of scholars as measured by WoS. The paper discusses the strengths and weaknesses of WoS, Scopus, and GS, their overlap and uniqueness, quality and language of the citations, and the implications of the findings for citation analysis. The project involved citation searching for approximately 1,100 scholarly works published by the study group and over 200 works by a test group (an additional 10 faculty members). Overall, more than 10,000 citing and purportedly citing documents were examined. WoS data took about 100 hours of collecting and processing time, Scopus consumed 200 hours, and GS a grueling 3,000 hours.

Conclusions by the authors:

The study found that the addition of Scopus citations to those of WoS could significantly alter the ranking of scholars. The study also found that GS stands out in its coverage of conference proceedings as well as international, non-English language journals, among others. GS also indexes a wide variety of document types, some of which may be of significant value to researchers. The use of Scopus and GS, in addition to WoS, reveals a more comprehensive and accurate picture of the extent of the scholarly relationship between LIS and other fields, as evidenced by the unique titles that cite LIS literature (e.g., titles from Cognitive Science, Computer Science, Education, and Engineering, to name only a few). Significantly, this study has demonstrated that:

  1. Although WoS remains an indispensable citation database, it should not be used alone for locating citations to an author or title, and, by extension, journals, departments, and countries; Scopus should be used concurrently.
  2. Although Scopus provides more comprehensive citation coverage of LIS and LIS-related literature than WoS for the period 1996-2005, the two databases complement rather than replace each other.
  3. While both Scopus and GS help identify a considerable number of citations not found in WoS, only Scopus significantly alters the ranking of scholars as measured by WoS.
    Although GS unique citations are not of the same quality as those found in WoS or Scopus, they could be very useful in showing evidence of broader international impact than could possibly be done through the two proprietary databases.
  4. GS value for citation searching purposes is severely diminished by its inherent problems. GS data are not limited to refereed, high quality journals and conference proceedings. GS is also very cumbersome to use and needs significant improvement in the way it displays search results and the downloading capabilities it offers for it to become a useful tool for large-scale citation analyses.
  5. Given the low overlap or high uniqueness between the three tools, they may all be necessary to develop more accurate maps or visualizations of scholarly networks and impact both within and between disciplines (Börner, Chen, & Boyack, 2003; Börner, Sanyal, & Vespignani, 2006; Small, 1999; White & McCain, 1997).
  6. Each database or tool requires specific search strategy(ies) in order to collect citation data, some more accurately and quickly (i.e., WoS and Scopus) than others (i.e., GS).

(Accepted for publication in the Journal of the American Society for Information Science and Technology)

About these ads

About Wilfred Mijnhardt
RMIMR is my virtual playground, a place to reflect on issues from my professional context, my job as Policy Director at Rotterdam School of Management, Erasmus University (RSM). RSM is the international university based business school at Erasmus University Rotterdam. More info here: www.rsm.nl Here is my list of relevant publications on the topic of my RMIMR weblog: http://www.mendeley.com/collections/694621/RMIMR-Repository/ The rss feed for my RMIMR collection is here: http://www.mendeley.com/collections/rss/694621/ Here is my other weblog on impact of research: http://www.scoop.it/t/dualimpact

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

RSS Business School News

  • Harvard Business School Club of Wisconsin honors John A. Mellowes - Milwaukee Journal Sentinel May 27, 2015
    Harvard Business School Club of Wisconsin honors John A. MellowesMilwaukee Journal SentinelMellowes was honored Tuesday night by the Harvard Business School Club of Wisconsin as the 2014 Wisconsin Business Leader of the Year. The chairman emeritus of Charter Manufacturing joined his family's business in 1965 and served as chairman and ...
  • New $27M business school opens at Farmingdale College - Real Estate Weekly May 26, 2015
    Real Estate WeeklyNew $27M business school opens at Farmingdale CollegeReal Estate WeeklyThe new, three-story, $19.3-million School of Business is one of the most architecturally prominent and technologically advanced higher education structures in the Northeast, according to Stalco Construction principal Kevin G, Harney. “The building ...
  • Longtime ESU professor Rich named interim business school dean - Topeka Capital Journal May 26, 2015
    Topeka Capital JournalLongtime ESU professor Rich named interim business school deanTopeka Capital JournalJohn Rich has 45 years of service at the university as a professor of accounting in addition to his current role as associate dean of the School of Business. In his new role as interim dean, he replaces Kristie Ogilive, who left Emporia State to take a . […]
  • Authenticity In The Workplace Is Tied Closely To Morality, Joint Business ... - Chicago Inno May 26, 2015
    Chicago InnoAuthenticity In The Workplace Is Tied Closely To Morality, Joint Business ...Chicago InnoJoint research from Northwestern's Kellogg School of Management, Harvard Business School, and Columbia Business School found that our sense of authenticity is linked to our morality: if we act inauthentically, it causes moral distress to a similar ...
  • Gardner-Webb mourns loss of former business school professor, Dr. Charles ... - Shelby Star May 26, 2015
    Shelby StarGardner-Webb mourns loss of former business school professor, Dr. Charles ...Shelby StarTichenor, a U.S. Navy veteran and former international business executive, passed away May 19. He was 89. Tichenor came to Gardner-Webb in 1997. After several years he founded the business school's Graduates in Executive Management (GEM) ...
  • Make superfunds invest in critical infrastructure, proposes Business School - Professional Planner May 26, 2015
    Make superfunds invest in critical infrastructure, proposes Business SchoolProfessional PlannerThe University of Sydney Business School has proposed that governments' require superannuation funds to invest in infrastructure development in return for what it describes as the “generous” tax concessions currently enjoyed by the sector. An ...and more » […]
  • Silicon Valley Companies Turn To Top Business Schools For Talent - BusinessBecause May 25, 2015
    BusinessBecauseSilicon Valley Companies Turn To Top Business Schools For TalentBusinessBecauseIn the UK at London Business School, Amazon was the third-largest recruiter in 2014, ahead of Citibank and Deloitte. At INSEAD, Microsoft hired more MBA students than both Accenture and PwC. “They still need the brightest and best minds to drive the ...Businesses, u […]
  • Double celebration for UU Business School - Belfast Newsletter May 25, 2015
    Belfast NewsletterDouble celebration for UU Business SchoolBelfast NewsletterAccounting student Yuqing Li, second right, celebrates the 10 year partnership between the Ulster University Business School and Dongbei University in China with, from left, Head of School, Professor Marie McHugh, Chinese Deputy Consul General Meng ...
  • Harvard Business School study proves the humblebrag is a useless waste of time - Vox May 22, 2015
    VoxHarvard Business School study proves the humblebrag is a useless waste of timeVoxIf you are going to brag about what you did this weekend, here is a tip to pull it off, which comes to us via a Harvard Business School working paper: brag, complain, or be humble, but do not humblebrag.
  • My top five takeaways from business school - The Globe and Mail (subscription) May 22, 2015
    The Globe and Mail (subscription)My top five takeaways from business schoolThe Globe and Mail (subscription)Linda Chew is enrolled in the two-year, full-time MBA program at Columbia University in New York. Originally from Vancouver, she is a graduate of the commerce program at Queen's University in Kingston. Linda began her career at Deloitte LLP, where […]
Locations of Site Visitors

Get every new post delivered to your Inbox.

%d bloggers like this: