Digital Libraries (cs.DL)

  • PDF
    We study relationship between peer assessment of quality of U.S. Computer Science (CS) doctoral programs and objective measures of research strength of those programs. In Fall 2016 we collected Google Scholar citation data for 4,352 tenure-track CS faculty from 173 U.S. universities. The citations are measured by the t10 index, which represents the number of citations received by the 10th highest cited paper of a faculty. To measure the research strength of a CS doctoral program we use 2 groups of citation measures. The first group of measures averages t10 of faculty in a program. Pearson correlation of those measures with the peer assessment of U.S. CS doctoral programs published by the U.S. News in 2014 is as high as 0.890. The second group of measures counts the number of well cited faculty in a program. Pearson correlation of those measures with the peer assessment is as high as 0.909. By combining those two groups of measures using linear regression, we create the Scholar score whose Pearson correlation with the peer assessment is 0.933 and which explains 87.2% of the variance in the peer assessment. Our evaluation shows that the highest 62 ranked CS doctoral programs by the U.S. News peer assessment are much higher correlated with the Scholar score than the next 57 ranked programs, indicating the deficiencies of peer assessment of less-known CS programs. Our results also indicate that university reputation might have a sizeable impact on peer assessment of CS doctoral programs. To promote transparency, the raw data and the codes used in this study are made available to research community at http://www.dabi.temple.edu/~vucetic/CSranking/.

Recent comments

lucy.vanderwende May 07 2015 16:13 UTC

The authors will want to look at work that Simone Teufel has done, in particular her Argumentative Zoning, which discusses the stance that the paper author takes with respect to the citations in that paper.

Steve Flammia Feb 05 2013 22:31 UTC

Here's our man: http://www.abdelaty.com/pup.htm
The links on the left are in Arabic, but some of them still have English text when you click through.

He also has an El Naschie-like photo montage of himself posing with famous scientists:
http://www.abdelaty.com/pic.htm

He is a prolific autho

...(continued)
Māris Ozols Feb 05 2013 15:57 UTC

This one is an interesting read...

It provides a novel way of measuring the impact factor and h-index as a percentage. In this way we can compare different journals and authors on an absolute scale! The only drawback is that the new method works only for Arabic journals.

Needless to say, the p

...(continued)
Earl Campbell Feb 06 2013 07:51 UTC

There is certainly some originality in the research of Abdel-Aty. For instance, he seems to be the first person to have gone realised that the concept of entanglement sudden death can be inverted to study entanglement sudden *birth*.

Earl Campbell Feb 06 2013 07:57 UTC

Also, seems that Barry Sanders has had some interaction with this Abdel-Aty before. According to:
http://elnaschiewatch.blogspot.de/2010/07/somethings-going-on-at-amis.html
Barry used to be managing editor of the AMIS journal, but is no involved in the journal!