Scopus’s view of computer science research
Posted by Bertrand Meyer on 28 July 2011
In the Informatics Europe report on researcher evaluation for computer science [1], we noted how awful the ISI Web of Knowledge was for computer science.We keep receiving notes of thanks from academics in various countries telling us that they use the article as a defense against misinformed colleagues from other disciplines wanting to apply ISI citations to the evaluation of computer scientists.
The report did not discuss ISI’scompetitor, Elsevier’s Scopus. Today I received a publicity from Scopus, which invited me to check the “top 25 hottest articles in computer science”; I was curious to see how they see the field.
The result is copy-pasted below. It is pathetic. The only really relevant references, out of 25, are five survey articles on wireless networks (only two of which seem to focus on CS issues: security and algorithms). To this we might add a couple of references on cloud computing that address CS issues such as security. The rest is about sociology ( “Social anxiety and technology: Face-to-face communication versus technological communication among teens” — great title, though!) and business (“The critical success factors for ERP implementation”).
If this is what was “hottest” in computer science between January and March 2011, most of us are in the wrong business.
This kind of thing makes for a good laugh. Things become less funny when we think of the consequences. Yes, some computer science researchers will be evaluated based on this kind of absurdity. What can we do?
Reference
[1] Bertrand Meyer, Christine Choppy , Jørgen Staunstrup and Jan van Leeuwen: Research Evaluation in Computer Science, Communications of the ACM article and Informatics Europe report, accessible from here.
[2] Scopus (SciVerse): Top 25 Hottest Articles in Computer Science (retrieved 28 July 2011), available at top25.sciencedirect.com/subject/computer-science/7/.
Text below from Scopus/SciVerse (reference [2] above)
![]()
January to March 2011
| 1. |
Synthesis of multifractional Gaussian noises based on variable-order fractional operators • Article |
| 2. |
Robust FIR equalization for time-varying communication channels with intermittent observations via an LMI approach • Article |
| 3. |
Personality and motivations associated with Facebook use • Article |
| 4. |
Social network use and personality • Article |
| 5. |
Facebook(R) and academic performance • Article |
| 6. |
Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility • Article |
| 7. |
Cloud computing – The business perspective • Article |
| 8. |
Wireless sensor networks: a survey • Article |
| 9. |
Students’and teachers’use of Facebook • Review article |
| 10. |
Identity construction on Facebook: Digital empowerment in anchored relationships • Article |
| 11. |
Wireless sensor network survey • Article |
| 12. |
All about me: Disclosure in online social networking profiles: The case of FACEBOOK • Article |
| 13. |
Internet social network communities: Risk taking, trust, and privacy concerns • Article |
| 14. |
A survey on security issues in service delivery models of cloud computing • Review article |
| 15. |
Social anxiety and technology: Face-to-face communication versus technological communication among teens • Article |
| 16. |
A survey on clustering algorithms for wireless sensor networks • Article |
| 17. |
Online social networks: Why do students use facebook? • Article |
| 18. |
The Internet of Things: A survey • Article |
| 19. |
Why people use social networking sites: An empirical study integrating network externalities and motivation theory • Article |
| 20. |
Who interacts on the Web?: The intersection of users@? personality and social media use • Article |
| 21. |
The critical success factors for ERP implementation: an organizational fit perspective • Article |
| 22. |
Multi-criteria decision making approaches for supplier evaluation and selection: A literature review • Article |
| 23. |
Addressing cloud computing security issues • Article |
| 24. |
Understanding knowledge sharing in virtual communities: An integration of social capital and social cognitive theories • Article |
| 25. |
NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey • Article |

Bertrand Meyer's technology blog » Blog Archive » Scopus’s view of computer science research said
[...] var addthis_product = 'wpp-261'; var addthis_config = {"data_track_clickback":true};I posted on the Informatics Europe blog a short note about what Scopus sees as the hottest articles in computer science. VN:F [...]
Luis Caires said
Hi,
This anomaly is a consequence of the particular journal selection used by Scopus. A way around this would be to pick a particular subset of the indexed journals within CS, using the selection list on the left of the web page. Oops, unfortunately, the Scopus journal list in CS is surprisingly partial, e.g., it does not seem to include any ACM journal, just to give an example. It does not include conferences as well.
By the way, the SCIMAGO index, used by many governmental evaluation agencies, builds on Scopus, so incompleteness is propagated.
The real drama with CS bibliometrics (assuming it is useful)
is than we really lack a proper database, with independent certification and citation counts.
How can we the community make it happen?
Can Informatics Europe help about that? I guess we informaticians/computer scientists need to make something about that, eventually. That would be an important advance for properly placing our field within the broader scientific community.
It is a pity that DBLP does not track citation counts.
Best, Luis
jameskjx said
The problem is it’s looking at journals, not conference articles.
Microsoft Academic Search may not be there yet, but it is getting there.
And Google Scholar isn’t that bad – but either is better than Scopus.
Bertrand Meyer said
Actually, the restriction to journals is only part of the problem. Even considering just computer science journals (but see Luis Caires’s comments), the results should be very different.
Michael Habib said
Hi Bertrand,
Just a quick clarification, the above ranking isn’t actually from Scopus, it is from ScienceDirect. It is only looking at raw usage counts of full-text available in ScienceDirect. Scopus data is not used in this lists compilation. Scopus citations were not considered when this list was calculated. I apologize if any messaging around the site was misleading..
Best,
Michael Habib
Product Manager, Scopus.
Luis Caires said
Of interest to this thread. LC
==>
Computing giants launch free science metrics: Nature news
“New Google and Microsoft services promise to democratize citation data.”
http://www.nature.com/news/2011/110802/full/476018a.html
Michael Habib said
Hello,
This list is actually not compiled using Scopus data. No citation analysis was involved in producing this list. It is a listing of top downloaded articles on ScienceDirect.
Best,
Michael Habib
Product Manager, Scopus
habib@elsevier.com