In the previous post we have presented one part of our topic modelling exercise in which we have investigated which of the 100 identified topics were represented in the journal of Global Environmental Change (GEC) more than any other journal. These topics represent the distinctive aspects of the journal and analysing their distribution over the years will allows us to investigate whether and how the journal has changed over the years. By correlating the results of our labelling exercise and multi-dimensional analysis we can observe in what manner, or which type of papers and contexts, these topics are usually discussed. More importantly, as these topics are computationally calculated groups of words, identifying the contexts in which these topics occur in will allow us to interpret the topics themselves. Continue Reading
Paper labelling was an exercise we categorised papers published in the journal of Global Environmental Change (GEC) in order to gain further insights into the types of papers that were published in the journal and to aid the interpretation of other analyses we employed. The papers were labelled, or categorised, in a bottom-up approach in which categories were established by reading a number of papers from the journal.
Initially we developed a system with seven categories, but these proved either too specific or too closely related, resulting in poor agreement when we categorised papers independently. Thus the number of categories was reduced and their description broadened. The final set included four categories: 1) Empirical, 2) Policy discussion, 3) Research agenda and Research Framework and 4) Other papers. Using this framework we have achieved a reasonable agreement rate (76.6%) between two researchers. Continue Reading