The one last parallel panel/metric RAE, in 2008, will provide a unique natural testbed for validating the rich new spectrum of Open Access metrics against the panel rankings. A statistical technique called multiple regression analysis can compute the contribution of each individual metric to the joint correlation of all the metrics with the RAE panel rankings. Once initialized by being validated against the panel rankings, the relative weight of each metric can then be adjusted and optimised according to the needs and criteria of each discipline, with the panels only serving as overseers and fine-tuners of the metric output, rather than having to try to re-review all the publications. This will allow research productivity and progress to be systematically monitored and rewarded.27
This is a natural, ‘horizontal’ extension of Citebase’s current functionality but it does not need to be restricted to the UK RAE: once validated, the metric equations, with the weights suitably adjusted to each field, can provide ‘continuous assessment’ of the growth and direction of scientific and scholarly research. Not only will the network of P-OA IRs do double duty by providing access to research for researchers as well as serving as the database for the field of scientometrics, but it will also provide an incentive for data-archiving (D-OA) alongside publication-archiving (P-OA) for other fields too, both by providing an example of the power and potential of such a worldwide database in scientometrics and by providing potential new impact metrics for research data-impact, alongside the more familiar metrics for research publication-impact.
Citebase has already been able to demonstrate that, in physics, OA self-archiving dramatically enhances citation impact (Figure 4a) for articles deposited in Arxiv, compared to articles in the same journal and year that are not self-archived.28 Lawrence 29 had already shown this earlier for computer science. The advantage has since been confirmed in 10 further disciplines (Figure 4b) using the bibliographic metadata from the ISI Science and Social Science Citation Index (on CD-ROM leased to OST at UQAM) for millions of articles in thousands of journals, for which robots then trawled the web to see whether they could find a free online (OA) versions of the full text. An OA/non-OA citation advantage – OA articles are cited more than non-OA articles in the same journal and year - has been found in every discipline tested so far (and in every year except the two very first years of Arxiv).