While browsing my Twitter feed, I stumbled across the article in the Chronicle of Higher Education discussing the latest tool for analyzing the impact of a researchers’ publication in a discipline. Instantaneous feedback from programs like Google Analytics has helped bloggers, website creators, and librarians increase their understanding of who, where, and when their sites are being accessed and read. Among the journal publishers, Elsevier is now coming to the impact analysis part with their SciVal Spotlight tool. In contrast to other analyzers like Google Scholar, Reuters Thomson’s citation indices, and Springer’s AuthorMapper (it’s free!), Elsevier attempts to review and categorize articles (instead of journals) into one of their 80,000 clusters, allowing for “a much more precise picture of influential work in emerging fields.” In conjunction to the bibliometric analyzer, Elsevier also looks to be creating a SciVal Funding database to connect researchers to funding opportunities.
Now, as libraries face budget cuts and collection development demands, tools like these could potentially be of great value in researching and ranking resources of interest and value for our institutions. Our researchers would also benefit from access to this resource to understand other, related research in the field. However, this all assumes a level of accuracy in the cataloging of these articles.
Sadly, I feel somewhat disappointed in the premature results, as the same problems that face the keyword indexing of journals in databases remains anything but precise and consistent, continues in the citation indexer. While I don’t have access to Elsevier’s edition, I did test some searches in Springer’s AuthorMapper.
Although a variety of subjects are listed below for browsing, I chose to conduct my own topic search on Dante. What I found was that most of my results were not based on the author Dante Alighieri of the Commedia, but others, particularly in the sciences, that had Dante somewhere in their name and primarily were based in South America.
Like any good librarian, I decided perhaps the fault was my own for not refining my search phrase enough. So, using his full name Dante Alighieri, I was able to find many more results related to the specific Dante I was after (yes, the results under Mineralogy do related to Dante Alighieri). However, upon reviewing the various facets, I found that while 18 articles were tagged as Comparative Literature and Linguistics, 12 articles were still related to Medicine and Public Health. While the concepts of medieval science do arise throughout Dante’s writing, 12 seems a bit excessive. Upon reviewing the journals list, Deutsche Zeitschrift fur Chirugie (Langenbeck’s Archives of Surgery) is the 4th most popular journal to appear in the list!
These inaccuracies are evidence to just some of the problems bibliometric analyzers have in reviewing research, let alone the issues of citation inflation by colleagues and friends. Even misspelling Dante’s name as Dante Aligheri still provides another single search results that falls outside of its proper retrieval space.
So, in short, while these tools may be helpful, like the Internet, information literacy will be key in deciphering these results as validity is not guaranteed.