Insights Blog

ERA Case Studies: Chemical Sciences Behavioural Responses

ERA Case Studies: Chemical Sciences Behavioural Responses

21 June 2013, by Professor Emeritus Frank Larkins

Frank Larkins is Professor Emeritus in the School of Chemistry at the University of Melbourne. He is a former Deputy Vice-Chancellor at that university, Dean of Science and Dean of Land and Food Resources. He has published more than 200 scientific papers. His current interests are in research, education and energy policy developments. He is the author of a book entitled Australian Higher Education Research Policies and Performance 1987-2010 (MUP 2011).

 

 

Proponents for the various ERA disciplines refined their responses to the 2012 assessments based on the lessons learned from the 2010 round. In this article the responses of universities with regard to the chemical sciences sub-disciplines are examined. The number of universities assessed increased modestly from 26 to 29. However, many more researchers and research outputs were evaluated in 2012 compared with 2010. By contrast, the number of units of evaluation that were assessed actually decreased from 86 to 82, but with a higher proportion being rated at or above world standard. The flexibility in assigning research outputs to discipline codes is a major factor in accounting for the very significant growth in journal articles. Overall, the response of the chemical sciences community has been rather different to that of the information and computing sciences community profiled earlier.

Physical chemistry is the dominant sub-discipline in terms of the research outputs assessed and the number of universities rated at or above world standard. The University of Queensland is the top ranked Australian university for the chemical sciences in 2012 based on the limited data available. This finding does not align with the 2013 QS rankings for chemistry, where four Australian universities, but not Queensland, are ranked in the top 50 world universities for the discipline. There are very few identifiable chemistry departments remaining in Australian Universities, but the chemical sciences sub-disciplines are strong, being predominantly embedded in other multidisciplinary entities.

The robustness of any external evaluation of performance is limited by the lack of volume data available by university and by sub-discipline. Transparency and confidence in the ERA process would be greater if the ARC was to release the volume data. The decision by government to link some research funding to the ERA quality assessments strengthens the case for fuller disclosure.

Download full case study (pdf).

Bookmark and Share

Comments

June 24th, 2013 at 4:12pm
Bill Skinner (UniSA)
Hi Frank
A very understandable change in 2012 relative to 2013. You correctly point out the change in rules regarding the allocation of published output to disciplines of choice, as a key influence on institution strategy. However, there are a couple of things tied up in this.

1) There was a condition that was supposed to make sure that a threshold percentage of the particular publication output was actually in that discipline. I can well understand that there was little or no capacity within the ERA process to check this was the case for each article, and I'm sure some bending of the rule was undertaken.
2) In 2010, because of the "shoe-horning" of journals into disciplines, many high quality publications were lost to the system because of thresholds not being met. This was certainly true for us here at UniSA. For example, we had quite a few 0914 Resource Engineering-related papers in high-ranked 0404 Geochemistry journals in 2010. As far as I'm aware, there are no stats for below threshold outputs, or are there?
3) Within an institution, there are also rivalries which, due to journal-discipline assignments in 2010, enabled some disciplines to rank higher than expected - to the detriment of otherwise accepted leading disciplines. Some of these dropped in the 2012 rankings.
4) Lastly, 2010 saw a few low-performing surprises. In many of these cases, the institution basically let things fall where they may, particularly around multi-coded outputs. They didn't make the same mistake twice.

Notwithstanding all this, transparency is the key. I, for one, would like to see two iterations of ERA with exactly the same rules. In a perfect world, it would be a boon to Govt if they knew where in institutions the high-ranked work was being done - at the research unit level.

Cheers
Bill
July 11th, 2013 at 8:38pm
StevenSmith
This sounds to be a real great blog in regards to Chemical Sciences Behavioral, loved reading it out, seems to be real great. <a href="http://www.nypreptutors.com/test-prep/sat-psat-tutor/">SAT tutor Long island</a>
July 12th, 2013 at 4:08pm
Bill Skinner (UniSA)
I would add another interesting and somewhat irresponsible behaviour.

In looking at detail on some disciplines (I haven't the time to manually sift data that is in an unhelpful form), I've noticed quite a few institutions that received significant ARC funding in a specific discipline (2005-2010), that did not have that discipline assessed!

If the ARC were to take this seriously, it would direct the panels to not award any further funding to these institutions under the FoR codes assigned until there is adequate explanation for the lack of outcomes.
About Insights

Insights is a regular feature of the LH Martin Institute e-Newsletter, presenting opinion pieces from tertiary education's leaders and experts. Subscribe to the e-newsletter.

* The views and comments expressed in 'Insights' belong to the author and do not necessarily reflect those of LH Martin Institute.

Contributors
All Articles
Paul Abela (1)
Muneer Ahmed (2)
Prof Warwick Anderson (1)
Professor Awang Bulgiba Awang Mahmud (1)
Anne-Marie Birkill (1)
Liz Bare (2)
Fabiana Barros de Barros (2)
Janet Beard (1)
Prof Warren Bebbington (1)
Prof Sharon Bell (1)
Doron Ben-Meir (1)
Peter Bentley (5)
Tom Boland (1)
Prof Sandra Bohlinger (1)
Prof. Victor (Vic) Borden (1)
Prof Tim Brailsford (1)
Professor Linda Butler (1)
Angel Calderon and Karen L. Weber (1)
Emeritus Prof Richard Carter (1)
Pam Caven (1)
Rosalind Chan (1)
Pam Christie (1)
Prof Roy Crawford (2)
Prof Stephen Crump & Linda Cooper (1)
Dr Heather Davis (4)
Prof Glyn Davis (1)
Associate Prof. Stijn Dekeyser (1)
Prof John Dewar (1)
Martin Doel OBE (1)
Mari Elken (1)
Lorelle Espinosa (1)
Dr Peter Ewell (1)
Professor Mike Ewing (1)
Penny Fenwick & Dr Jan Cameron (1)
Neil Fernandes (1)
Claire Field (1)
Jon File (2)
Pat Forward (1)
Dr Nick Fredman (3)
Prof. Leo Goedegebuure (3)
Ian Gostelow (1)
Carroll Graham (1)
Carol Harding (1)
Prof Elizabeth Harman (1)
Tony Heywood (1)
Professor Jeroen Huisman (2)
Professor Anne Jones (1)
Tom Karmel (2)
Sharon Kerr (2)
Prof Denise Kirkpatrick (1)
Prof Linda Kristjanson (1)
Eunyoung Kyung (1)
Professor Emeritus Frank Larkins (17)
Mary Leahy (1)
Megan Lilly (1)
Prof David G Lloyd (1)
Bruce Mackenzie (1)
Hon. Steve Maharey (1)
Derek McCormack (1)
Prof. Stuart McCutcheon (1)
Prof V. Lynn Meek (1)
Prof Robin Middlehurst (1)
Gavin Moodie (2)
Bruce Muirhead (2)
Huong Nguyen (1)
Peter Noonan (1)
Andrew Norton (1)
Prof Gareth Parry (2)
Prof Alan Pettigrew (1)
Barbara Pocock (1)
Professor Richie Poulton (1)
Dr Joanne Pyke (2)
Dr Sarah Richardson and Assoc. Prof. Hamish Coates (1)
Julie Rowlands (1)
Professor Yoni Ryan (1)
Dr Ruth Schubert (4)
Kevin Seales (1)
Jeffrey Selingo (1)
Dr Geoff Sharrock (3)
Robin Shreeve (1)
Denise Stevens (1)
Jan Stevenson (1)
Associate Professor Elaine Stratford (2)
Marian Mahat (6)
Dr Ly Tran (1)
Prof Andrew Vann (1)
Prof Frans van Vught (1)
Prof Pat Walsh (2)
Professor Robert Wagenaar (1)
Professor Paul Wellings (1)
Dr Julie Wells (1)
Assoc Prof Leesa Wheelahan (6)
David Windridge (1)
Dr Peter Woelert (1)
Dr Peter Woelert and Dr Victoria Millar (1)
Serena Yu (1)
Dr Nadine Zacharias (1)
Dr Stefan Popenici (1)
Dennis Murray (2)
Alan Lawler (1)
Andrew Gunn and Michael Mintrom (1)
Mark Tayar & Rob Jack (1)
Assoc Prof Damien Harkin (2)
Rafael Arruda Furtado & Tatiana deCampos Aranovich (1)
Dr Jan Cameron (1)
Jim Davidson (1)
James Barron (1)
Anne Dening (1)
Lea Patterson (1)
Ms Åsa Olsson (1)
Jennifer Westacott (1)
Maree Conway (1)
Qingcheng Li (1)
Prof. Vin Massaro (1)
Bianca Durrant (1)
Archives
2014
September (4)
August (4)
July (6)
June (4)
May (3)
April (5)
March (4)
February (4)
January (3)
2013
November (4)
October (4)
September (4)
August (8)
July (5)
June (6)
May (5)
April (4)
March (4)
February (5)
January (2)
2012
November (3)
October (3)
September (6)
August (5)
July (2)
June (2)
May (2)
April (3)
March (5)
February (4)
January (2)
2011
November (4)
October (4)
September (6)
August (3)
July (3)
June (3)
May (4)
April (1)
March (2)
February (1)
January (2)
2010
November (2)
October (2)
September (4)
August (3)
July (2)
June (2)
http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p01.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p02.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p03.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p04.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p05.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p06.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p07.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p08.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p09.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p10.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p11.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p12.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p13.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p14.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p15.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p16.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p17.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p18.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p19.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p20.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p21.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p22.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p23.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p24.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p25.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p26.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p27.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p28.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p29.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p30.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p31.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p32.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p33.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p34.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p35.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p36.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p37.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p38.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p39.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p40.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p41.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p42.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p43.html http://www.lhmartininstitute.edu.au/birkenstock/Birkenstock-p44.html