There have been many complaints about university rankings and observers have suggested that the rankers themselves should be subject to some sort of ranking or rating. The International Network of Research Management Societies (INORMS), an association of groups involved in the management of research, has started a Research Evaluation Working Group (REWG) dedicated to making research evaluation as effective as possible.
The REWG is concerned with making global university rankings fair and responsible. It has started a Rating the Rankers initiative that has compiled criteria by which rankings can be judged.
Ranking organisations have been given an opportunity for self-assessment and will be evaluated by a panel of international experts. Questions will be concerned with good governance, transparency, measuring what matters, and rigour. At the moment six international rankings are slated for assessment: Times Higher Education World University Rankings, QS World University Rankings, the Shanghai Academic Ranking of World Universities, the US News Best Global Universities, CWTS Leiden Ranking and U-Multirank. It is expected that more rankings will be rated in the future.