Informatics Europe

The forum for IT research and education in Europe

Scopus’s view of computer science research

Posted by Bertrand Meyer on 28 July 2011

In the Informatics Europe report on researcher evaluation for computer science [1], we noted how awful the ISI Web of Knowledge was for computer science.We keep receiving notes of thanks from academics in various countries telling us that they use the article as a defense against misinformed colleagues from other disciplines wanting to apply ISI citations to the evaluation of computer scientists.

The report did not discuss ISI’scompetitor, Elsevier’s Scopus. Today I received a publicity from Scopus, which invited me to check the “top 25 hottest  articles in computer science”; I was curious to see how they see the field.

The result is copy-pasted below. It is pathetic. The only really relevant references, out of 25, are five survey articles on wireless networks (only two of which seem to focus on  CS issues: security and algorithms). To this we might add a couple of references on cloud computing that address CS issues such as security. The rest is about sociology ( “Social anxiety and technology: Face-to-face communication versus technological communication among teens” — great title, though!) and business (“The critical success factors for ERP implementation”).

If this is what was “hottest” in computer science between January and March 2011, most of us are in the wrong business.

This kind of thing makes for a good laugh. Things become less funny when we think of the consequences. Yes, some computer science researchers will be evaluated based on this kind of absurdity. What can we do?

Reference

[1] Bertrand Meyer, Christine Choppy , Jørgen Staunstrup and Jan van Leeuwen: Research Evaluation in Computer Science, Communications of the ACM article and Informatics Europe report, accessible from here.

[2] Scopus (SciVerse): Top 25 Hottest Articles in Computer Science (retrieved 28 July 2011), available at top25.sciencedirect.com/subject/computer-science/7/.


Text below from Scopus/SciVerse (reference [2] above)


Top 25 Hottest Articles

January to March 2011

RSS RSS   Blog This Blog This!   Print   Show condensed
1.
Blog This!

Synthesis of multifractional Gaussian noises based on variable-order fractional operators • Article
Signal Processing, Volume 91, Issue 7, July 2011, Pages 1645-1650
Sheng, H.; Sun, H.; Chen, Y.; Qiu, T.

2.
Blog This!

Robust FIR equalization for time-varying communication channels with intermittent observations via an LMI approach • Article
Signal Processing, Volume 91, Issue 7, July 2011, Pages 1651-1658
Zhang, H.; Shi, Y.; Saadat Mehr, A.; Huang, H.

3.
Blog This!

Personality and motivations associated with Facebook use • Article
Computers in Human Behavior, Volume 25, Issue 2, March 2009, Pages 578-586
Ross, C.; Orr, E.S.; Sisic, M.; Arseneault, J.M.; Simmering, M.G.; Orr, R.R.
Cited by SciVerse Scopus (19)

4.
Blog This!

Social network use and personality • Article
Computers in Human Behavior, Volume 26, Issue 6, November 2010, Pages 1289-1295
Amichai-Hamburger, Y.; Vinitzky, G.
Cited by SciVerse Scopus (1)

5.
Blog This!

Facebook(R) and academic performance • Article
Computers in Human Behavior, Volume 26, Issue 6, November 2010, Pages 1237-1245
Kirschner, P.A.; Karpinski, A.C.
Cited by SciVerse Scopus (2)

6.
Blog This!

Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility • Article
Future Generation Computer Systems, Volume 25, Issue 6, June 2009, Pages 599-616
Buyya, R.; Yeo, C.S.; Venugopal, S.; Broberg, J.; Brandic, I.
Cited by SciVerse Scopus (193)

7.
Blog This!

Cloud computing – The business perspective • Article
Decision Support Systems, Volume 51, Issue 1, April 2011, Pages 176-189
Marston, S.; Li, Z.; Bandyopadhyay, S.; Zhang, J.; Ghalsasi, A.

8.
Blog This!

Wireless sensor networks: a survey • Article
Computer Networks, Volume 38, Issue 4, March 2002, Pages 393-422
Akyildiz, I.F.; Su, W.; Sankarasubramaniam, Y.; Cayirci, E.
Cited by SciVerse Scopus (3949)

9.
Blog This!

Students’and teachers’use of Facebook • Review article
Computers in Human Behavior, Volume 27, Issue 2, March 2011, Pages 662-676
Hew, K.F.

10.
Blog This!

Identity construction on Facebook: Digital empowerment in anchored relationships • Article
Computers in Human Behavior, Volume 24, Issue 5, September 2008, Pages 1816-1836
Zhao, S.; Grasmuck, S.; Martin, J.
Cited by SciVerse Scopus (25)

11.
Blog This!

Wireless sensor network survey • Article
Computer Networks, Volume 52, Issue 12, August 2008, Pages 2292-2330
Yick, J.; Mukherjee, B.; Ghosal, D.
Cited by SciVerse Scopus (314)

12.
Blog This!

All about me: Disclosure in online social networking profiles: The case of FACEBOOK • Article
Computers in Human Behavior, Volume 26, Issue 3, May 2010, Pages 406-418
Nosko, A.; Wood, E.; Molema, S.
Cited by SciVerse Scopus (3)

13.
Blog This!

Internet social network communities: Risk taking, trust, and privacy concerns • Article
Computers in Human Behavior, Volume 25, Issue 1, January 2009, Pages 153-160
Fogel, J.; Nehmad, E.
Cited by SciVerse Scopus (37)

14.
Blog This!

A survey on security issues in service delivery models of cloud computing • Review article
Journal of Network and Computer Applications, Volume 34, Issue 1, January 2011, Pages 1-11
Subashini, S.; Kavitha, V.
Cited by SciVerse Scopus (2)

15.
Blog This!

Social anxiety and technology: Face-to-face communication versus technological communication among teens • Article
Computers in Human Behavior, Volume 25, Issue 6, November 2009, Pages 1367-1372
Pierce, T.
Cited by SciVerse Scopus (8)

16.
Blog This!

A survey on clustering algorithms for wireless sensor networks • Article
Computer Communications, Volume 30, Issue 14-15, October 2007, Pages 2826-2841
Abbasi, A.A.; Younis, M.
Cited by SciVerse Scopus (175)

17.
Blog This!

Online social networks: Why do students use facebook? • Article
Computers in Human Behavior, August 2010
Cheung, C.M.K.; Chiu, P.Y.; Lee, M.K.O.

18.
Blog This!

The Internet of Things: A survey • Article
Computer Networks, Volume 54, Issue 15, October 2010, Pages 2787-2805
Atzori, L.; Iera, A.; Morabito, G.
Cited by SciVerse Scopus (12)

19.
Blog This!

Why people use social networking sites: An empirical study integrating network externalities and motivation theory • Article
Computers in Human Behavior, Volume 27, Issue 3, May 2011, Pages 1152-1161
Lin, K.Y.; Lu, H.P.

20.
Blog This!

Who interacts on the Web?: The intersection of users@? personality and social media use • Article
Computers in Human Behavior, Volume 26, Issue 2, March 2010, Pages 247-253
Correa, T.; Hinsley, A.W.; de Zuniga, H.G.
Cited by SciVerse Scopus (14)

21.
Blog This!

The critical success factors for ERP implementation: an organizational fit perspective • Article
Information & Management, Volume 40, Issue 1, October 2002, Pages 25-40
Hong, K.-K.; Kim, Y.-G.
Cited by SciVerse Scopus (258)

22.
Blog This!

Multi-criteria decision making approaches for supplier evaluation and selection: A literature review • Article
European Journal of Operational Research, Volume 202, Issue 1, April 2010, Pages 16-24
Ho, W.; Xu, X.; Dey, P.K.
Cited by SciVerse Scopus (19)

23.
Blog This!

Addressing cloud computing security issues • Article
Future Generation Computer Systems, December 2010
Zissis, D.; Lekkas, D.

24.
Blog This!

Understanding knowledge sharing in virtual communities: An integration of social capital and social cognitive theories • Article
Decision Support Systems, Volume 42, Issue 3, December 2006, Pages 1872-1888
Chiu, C.M.; Hsu, M.H.; Wang, E.T.G.
Cited by SciVerse Scopus (117)

25.
Blog This!

NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey • Article
Computer Networks, Volume 50, Issue 13, September 2006, Pages 2127-2159
Akyildiz, I.F.; Lee, W.Y.; Vuran, M.C.; Mohanty, S.
Cited by SciVerse Scopus (1036)

7 Responses to “Scopus’s view of computer science research”

  1. [...] var addthis_product = 'wpp-261'; var addthis_config = {"data_track_clickback":true};I posted on the Informatics Europe blog  a short note about what Scopus sees as the hottest articles in computer science. VN:F [...]

  2. Luis Caires said

    Hi,
    This anomaly is a consequence of the particular journal selection used by Scopus. A way around this would be to pick a particular subset of the indexed journals within CS, using the selection list on the left of the web page. Oops, unfortunately, the Scopus journal list in CS is surprisingly partial, e.g., it does not seem to include any ACM journal, just to give an example. It does not include conferences as well.
    By the way, the SCIMAGO index, used by many governmental evaluation agencies, builds on Scopus, so incompleteness is propagated.
    The real drama with CS bibliometrics (assuming it is useful)
    is than we really lack a proper database, with independent certification and citation counts.
    How can we the community make it happen?
    Can Informatics Europe help about that? I guess we informaticians/computer scientists need to make something about that, eventually. That would be an important advance for properly placing our field within the broader scientific community.
    It is a pity that DBLP does not track citation counts.
    Best, Luis

  3. jameskjx said

    The problem is it’s looking at journals, not conference articles.

    Microsoft Academic Search may not be there yet, but it is getting there.
    And Google Scholar isn’t that bad – but either is better than Scopus.

    • Actually, the restriction to journals is only part of the problem. Even considering just computer science journals (but see Luis Caires’s comments), the results should be very different.

  4. Hi Bertrand,

    Just a quick clarification, the above ranking isn’t actually from Scopus, it is from ScienceDirect. It is only looking at raw usage counts of full-text available in ScienceDirect. Scopus data is not used in this lists compilation. Scopus citations were not considered when this list was calculated. I apologize if any messaging around the site was misleading..

    Best,
    Michael Habib
    Product Manager, Scopus.

  5. Luis Caires said

    Of interest to this thread. LC

    ==>

    Computing giants launch free science metrics: Nature news

    “New Google and Microsoft services promise to democratize citation data.”

    http://www.nature.com/news/2011/110802/full/476018a.html

  6. Michael Habib said

    Hello,

    This list is actually not compiled using Scopus data. No citation analysis was involved in producing this list. It is a listing of top downloaded articles on ScienceDirect.

    Best,
    Michael Habib
    Product Manager, Scopus
    habib@elsevier.com

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s

 
Follow

Get every new post delivered to your Inbox.