Funders around the world have adopted open access policies that require funded work to be published in journals that are open access or self-archived within a certain time-frame (Prosser, 2007; Xia et al., 2012). Notable policies include the United States National Institutes of Health implemented in 2008 (Suber, 2008), the policies of Research Councils UK (RCUK), the UK Research Excellence Framework, and member states of the European Union (Higher Education Funding Council for England, 2016; Suber, 2012). Open access policies are implemented to ensure that taxpayers and other stakeholders are able to access the work that they fund and to support research and innovation by removing barriers to access. In support of this, previous work has shown that open access papers receive citations at a comparable, or even higher, rate than papers in subscription journals (Björk & Solomon, 2012; Gargouri et al., 2010).
Open access mandates are typically based on a green self-archiving model that requires researchers to deposit their accepted manuscript (Harnad et al., 2004, 2008). In the green open access model, authors publish with subscription journals and are required to deposit the accepted manuscript version of their paper in their institutional repository so that it can be made publicly available within a specified time-period. The allowed embargo period is usually 12 months, although Europe is moving towards a stricter 6 month period in the Horizon 2020 programme (European Commission, 2018). The RCUK policy provides an exception to the dominance of green open access policies with its strong preference for immediate open access and, as of 2013, was revised to provide block grants to institutions for open access payments (Ashworth, Mccutcheon, & Roy, 2014; Harnad, 2013). Most other jurisdictions such as the US, Canada, and Australia have introduced green open access policies that require papers to be publicly available within 12 months of publication through the self-archiving route.
The effectiveness of green open access policies has been heavily disputed. Although the strength of an open access policy can improve rates of self-archiving, overall rates of self-archiving remain low – in the order of 30% or less (Harnad, 2013; Vincent-Lamarre, Boivin, Gargouri, Larivière, & Harnad, 2015). In contrast, over 90% of academics believe that it is important to make research articles freely available to everyone (Zhu, 2017). But despite this widespread support and decades of effort by research librarians and open access advocates, rates of deposit have remained low while pirate open access has rapidly become widespread (Bohannon, 2016; Green, 2017).
It has been suggested that most academics are generally aware of open access policies but find compliance difficult due to time constraints or confusion about policy requirements or journal policies (Charbonneau & McGlone, 2013). Others have argued that academics, in particular early career researchers, are constrained by the need to publish in prestigious outlets that have high impact factors and accordingly deprioritise their support for open access in order to ensure their continuing employment (Nicholas et al., 2017). The vast majority of journals allow self-archiving after a specified embargo period (Harnad et al., 2008), so green open access theoretically allows for compliance with open access policy in almost any journal except where a journal’s embargo period is longer than the 12 months specified by funders.
Journal choice thus offers a way of assessing active disregard for open access policies rather than a passive failure to self-archive. If the policy is effective, then journals that embargo an author’s accepted manuscript for longer than the specified timeframe should see a reduction in submissions over time. Australia and Canada both recently introduced open access policies that require self-archiving within 12 months of publication (Moher et al., 2016; Steele, 2013). The National Health and Medical Research Council (NHMRC) in Australia introduced its open access policy in July 2012 and the Australian Research Council (ARC) introduced its policy at the beginning of 2013. While the Canadian Institutes of Health Research (CIHR) has had an open access policy for some time, the tri-agency open access policy introduced in 2015 now covers all of the major federal Canadian research funders. Therefore, if funder open access policies are effective then there should be a reduction in the number of publications in journals that have embargoes of more than 12 months for Australia and Canada.
Fortunately for neuroscientists, almost all of the journals owned by major publishers are compliant with 12-month green open access policies. All of Springer Nature’s subscription journals have embargoes of 6 months (Nature, 2018) or 12 months (Springer, 2018). Wiley embargoes author manuscripts for a standard 12-month period for scientific journals and has funder agreements with the ARC and NHMRC (Wiley, 2018). Commendably, SAGE Publishing’s self-archiving policy allows immediate deposit with an institutional repository, with embargo periods only applying to other databases (SAGE Publishing, 2018). Elsevier is the only major scientific journal publisher without a standard embargo policy and publishes a list of journal-specific embargo periods. Gray (2018) has maintained a public dataset that tracks the vast array of Elsevier’s journal-specific embargo periods since it began publishing its list in 2013. It shows that Elsevier retains a large number of journals with non-compliant (>12 months) embargo periods that have remained stable over this period.
We therefore studied the rate at which academics in neuroscience (our field of study) publish in journals with varying timeframes for open access. Based on previous studies that have shown limited practical enthusiasm for self-archiving (Charbonneau & McGlone, 2013; Vincent-Lamarre et al., 2015), we hypothesised that Australian and Canadian neuroscientists would not reduce their propensity to publish in non-compliant Elsevier journals. We used Elsevier’s Scopus database to examine the number of publications from Australian and Canadian neuroscientists in both compliant and non-compliant Elsevier journals from 2010 to 2017. For comparison, we also studied publications in open access neuroscience journals with the Directory of Open Access Journals (DOAJ) Seal and neuroscience publications in open access mega-journals (OAMJs). Our findings support the view that funder open access policies have little to no impact on journal selection in neuroscience.
We studied the rate of publication of neuroscientists with affiliations based in Australia and Canada from 2010 to 2017 in four types of journal: non-compliant Elsevier journals with embargoes of >12 months, compliant subscription journals published by Elsevier with embargoes of ≤12 months, discipline-specific immediate open access journals, and OAMJs.
We selected Elsevier journals from the list compiled by Gray (2018) based on embargo length. By manually scanning journal titles for words related to neuroscience, psychology, or neurological or psychological disorders, we identified 30 journals with non-compliant embargo periods of 18–24 months. For comparison, we also identified 58 journals with compliant 12-month embargo periods. We selected only journals that had the same embargo period for the entire 2013–2017 period as recorded by Gray (2018) and published neuroscience and psychology papers in English.
To select discipline-specific immediate open access journals, we searched the Directory of Open Access Journals (DOAJ) for journals with subject areas of neurosciences, biological psychiatry, neuropsychiatry, or psychology. We selected only journals (n=20) that publish in English, had the DOAJ seal, had been listed on the DOAJ since before 2010, and had been indexed by Scopus prior to 2010. We called these journals immediate open access because the term ‘gold open access’ is sometimes conflated with the article processing charge business model (Beall, 2013) and some open access advocates distinguish between ‘gold’ and fee-free ‘platinum’ journals (Björk, 2017). They were published by Frontiers (n=11), Springer (n=3 under BMC and n=1 under the Springer brand), Hindawi (n=3), and PAGEPress (n=1).
We also examined neuroscience publications across OAMJs (n=8). While PLOS ONE and Scientific Reports are the best known OAMJs, we also counted contributions from the much younger and/or smaller OAMJs PeerJ, Royal Society Open Science, Heliyon, BMJ Open, Biology Open, and FEBS Open Bio. Although several of these journals began after 2010, we did not apply exclusion criteria to this subset of journals because the OAMJ segment of publishing has experienced rapid shifts, particularly with respect to the rapid popularity of Scientific Reports.
2.1. Scopus Searches
We used Elsevier’s Scopus database because it is a widely used and authoritative bibliometric database and would likely have accurate metadata for Elsevier journals. In mid-2018, we conducted searches (Table 1) for the total number of publications from Australia, Canada, the United States (US), and United Kingdom (UK) in a particular journal using the journal’s ISSN and used the results analysis tool to export total publications per country per year for 2010–2017. We also conducted searches for publications that explicitly acknowledged either Australian funders who support neuroscience (ARC and NHMRC) or Canadian funders who support neuroscience (CIHR and the National Sciences and Engineering Research Council [NSERC]). In both search types, we excluded articles in press because these would have a final publication date of 2018 or later. For comparison with the Australian and Canadian data, we also obtained national publication counts for the US and UK. For OAMJs, we identified ‘neuroscience’ publications if the word ‘neuroscience’ occurred anywhere in the article’s metadata.
|Journal total||(ISSN(0166–4328) AND (EXCLUDE (DOCTYPE,”ip”)))|
|Funder acknowledgement||(ISSN(0166–4328) AND (FUND-ALL(National Health and Medical Research Council) OR FUND-ALL(NHMRC)OR FUND-ALL(Australian Research Council)OR FUND-ALL(ARC))) AND (LIMIT-TO (AFFILCOUNTRY,”Australia”)) AND (EXCLUDE (DOCTYPE, “ip”)) AND (LIMIT-TO (PUBYEAR, 2017) OR LIMIT-TO (PUBYEAR, 2016) OR LIMIT-TO (PUBYEAR, 2015) OR LIMIT-TO (PUBYEAR, 2014) OR LIMIT-TO (PUBYEAR, 2013) OR LIMIT-TO (PUBYEAR, 2012) OR LIMIT-TO (PUBYEAR, 2011) OR LIMIT-TO (PUBYEAR, 2010))|
|OAMJ total||(ALL (neuroscience) AND ISSN (1932–6203) AND (EXCLUDE (DOCTYPE, “ip”))|
|OAMJ funder acknowledgement||(ALL (neuroscience) AND ISSN(1932–6203) AND (FUND-ALL(Canadian Institutes of Health Research)OR FUND-ALL(CIHR)OR FUND-ALL(Natural Sciences and Engineering Research Council)OR FUND-ALL(NSERC))) AND (LIMIT-TO (AFFILCOUNTRY, “Canada”)) AND (EXCLUDE (DOCTYPE, “ip”)) AND (LIMIT-TO (PUBYEAR, 2017) OR LIMIT-TO (PUBYEAR, 2016) OR LIMIT-TO (PUBYEAR, 2015) OR LIMIT-TO (PUBYEAR, 2014) OR LIMIT-TO (PUBYEAR, 2013) OR LIMIT-TO (PUBYEAR, 2012 ) OR LIMIT-TO (PUBYEAR, 2011) OR LIMIT-TO (PUBYEAR, 2010))|
2.2. Statistical Analysis and Material Availability
Journal-specific totals were collated and summed to provide national totals or funder-acknowledging totals. The national totals and funder-acknowledging totals were analysed using the free open source statistics package JASP (JASP Team, 2018). Variables encoding for the existence of combined NHMRC/ARC open access policies (AU-policy) from 2013 onwards and tri-agency policy (CA-policy) from 2015 onwards were included in the data. Step-wise regression analysis was then performed with year, AU-policy, and CA-policy as independent variables and the number of publications as a dependent variable. The full list of journal titles, underlying data, and statistical analysis results are available on Figshare (Khoo & Lay, 2018).
3.1. Non-Compliant Journal Publishing
Scopus data shows that there are potentially hundreds of papers published each year in Elsevier journals with non-compliant self-archiving embargoes (n=30). As shown in Figure 1a, the national totals were higher than the funder-acknowledging totals but neither the introduction of the NHMRC and ARC’s open access policies (shown by the dashed blue line before 2013), nor the tri-agency open access policy in Canada in 2015 (shown by the black dashed line) had any effect on reducing Australian or Canadian neuroscientists’ rate of publication in non-compliant Elsevier journals.
Stepwise linear regression produced a model (R2=0.945, F(1,6)=103.2, p<0.001) for the Australian national total with only the year as a predictor (β=24.98, p<0.001). Paradoxically, the regression model for funder-acknowledging totals (R2=0.871, F(1,6)=40.47, p<0.001) included the Australian open access policy as a predictor, but with a positive coefficient (β=47, p<0.001). Stepwise linear regression found no significant predictors for the Canadian national total or funder-acknowledging totals. Similarly, there was no decrease in publishing in non-compliant journals in the US or UK (Figure 1b) because there were no significant predictors in either case.
3.2. Compliant Subscription Journals
Elsevier publishes many subscription journals with compliant self-archiving embargoes. We identified 58 journals within the fields of neuroscience and psychology. As shown in Figure 2a there appears to be little to no effect of funder open access policy on the rate at which authors publish in compliant subscription journals. The blue dashed line again represents the Australian policies implemented from 2013 and the black line represents Canada’s tri-agency policy in effect from 2015.
Stepwise linear regression produced a model (R2=0.878, F(1,6)=43.34, p<0.001) for the Australian national total with only the Australian policy as a predictor (β=143.4, p<0.001). However, when applied to papers that acknowledged Australian funders there was no significant regression equation. For Canadian neuroscience, a significant regression model was found for the national total (R2=0.861, F(1,6)=37.16, p<0.001) with year as the only predictor (β=24.31, p<0.001). Again, there was no significant regression equation for papers that acknowledged Canadian funders.
As shown in Figure 2b, the US had high output throughout 2010–2017. There was no significant regression equation for the US national total in compliant subscription journals. For the UK, a significant regression equation was found (R2=0.894, F(1,6)=50.53, p<0.001) with year as the only predictor (β=37.5, p<0.001).
3.3. Immediate Open Access Journals
It is possible that funder open access policies are generally driving uptake of open access publishing opportunities, so we also examined open access neuroscience journals. Since Elsevier does not publish a comparable number of fully open access journals, we examined 20 journals with the DOAJ Seal that publish neuroscience papers. We found that immediate open access outputs were increasing for both Australia and Canada (Figure 3a) and the US and UK (Figure 3b). However, the existence of Australian funder policy (blue dashed line) or Canadian funder policy (black dashed line) had little effect.
Stepwise linear regression produced a model (R2=0.932, F(1,6)=82.89, p<0.001) for the Australian national total with the Australian policy as a predictor of increased output (β=86.4, p<0.001). For papers that acknowledge Australian funders, the regression equation (R2=0.691, F(1,6)=13.4, p=0.011) only included year as a predictor (β=6.071, p=0.011). Regression equations for Canadian national totals (R2=0.81, F(1,6)=25.59, p=0.002) and funder acknowledgements (R2=0.823, F(1,6)=27.93, p=0.002) both included year as the only predictor (β=22.8 and 9.524, respectively, p=0.002).
For the US national total, stepwise linear regression produced a significant model (R2=0.734, F(1,6)=16.54, p=0.007) with year as its only predictor (β=89.14, p=0.007). For the UK, the regression equation (R2=0.768, F(1,6)=19.86, p=0.004) had the existence of the Australian funder policy (which coincided with the 2013 revised RCUK policy) as its only predictor (β=109.9, p=0.004).
3.4. Open Access Mega-Journals
Many neuroscientists publish articles in OAMJs, which are large interdisciplinary journals that use peer review to screen predominantly for scientific or technical soundness (Björk & Catani, 2016; Wakeling et al., 2017). We searched for neuroscience articles published in 8 OAMJs and found that neuroscience outputs in OAMJs were increasing in every jurisdiction (Figure 4).
Stepwise linear regression produced a model (R2=0.871, F(1,6)=40.56, p<0.001) for the Australian national total with year as a predictor of increased output (β=86.4, p<0.001). However, for papers that acknowledge Australian funders, the regression equation (R2=0.961, F(1,6)=62.29, p<0.001) included both year (β=10.67, p=0.031) and the Australian policy (β=55.27, p=0.023) as predictors. Regression equations for Canadian national totals (R2=0.926, F(1,6)=31.08, p=0.002) found the year (β=78, p=0.001) as a positive predictor, but that the implementation of the Canadian policy was negatively associated with Canadian neuroscience OAMJ publications (β=−168.5, p=0.033). For Canadian funder acknowledgements (R2=0.845, F(1,6)=32.74, p=0.001), the implementation of the Australian policy appeared to be a predictor of more OAMJ publications (β=109.6, p=0.001).
For the US national total, stepwise linear regression produced a significant model (R2=0.702, F(1,6)=14.17, p=0.009) with year as its only predictor (β=217.1, p=0.009). Similarly, the regression equation for the UK national total (R2=0.942, F(1,6)=97.19, p<0.001) had year as its only predictor (β=118.7, p<0.004).
The present study has found no evidence that funder open access policies reduce the rate at which neuroscientists publish in Elsevier journals with non-compliant embargo periods of more than 12 months. Australian output in non-compliant journals grew between 2010 and 2017, with the onset of combined ARC and NHMRC open access policies in 2013 coinciding with an increase in publications in non-compliant journals. Growth in scientific output has resulted in a general increase in scientific publications, with the most pronounced growth in immediate open access journals.
Our data suggests that Australian and Canadian neuroscientists do not generally consider funder open access policy prohibitions on publishing in journals with long embargo periods on self-archiving. The majority of academics do not self-archive their manuscripts even though it can provide benefits at no additional cost to them (Gargouri et al., 2010; Harnad, 2013; Vincent-Lamarre et al., 2015). However, failing to deposit a manuscript is a passive form of non-compliance with funder policies that may arise from uncertainty or lack of time (Charbonneau & McGlone, 2013). In contrast, publishing in a non-compliant journal requires an active decision to submit to a journal without regard to its embargo period whether through ignorance or indifference. While it is theoretically possible that some authors are compliant with open access mandates either by using an author addendum or by paying hybrid open access fees, authors almost universally sign copyright or license to publish agreements without modification (Charbonneau & McGlone, 2013) and the astronomical cost of publishing open access in hybrid journals usually deters the vast majority of authors (Laakso & Björk, 2016).
Another possibility is that authors publish in journals without regard to embargo periods but self-archive manuscripts in defiance of the publisher’s embargo. We briefly examined this possibility by using the open access button to search for self-archived copies of articles that were published in 2017 but were less than 18 months old (Emery, 2018; McArthur, MacGillivray, & Norori, 2013). Of 53 articles published by Australian authors, only 1 article had full text available from an Australian institutional repository, 1 article had full text under embargo, and another 18 had metadata only. Articles were more likely to be available from an international co-author’s institutional repository, with 3 articles available by this route. For 80 articles published by Canadian authors, 10 papers were available in either UK or PubMed Central repositories, again presumably deposited by international co-authors. We therefore estimate that the publisher embargo non-compliance rate for Australian and Canadian authors is less than 1%. This is consistent with our own use of Australian and Canadian institutional repositories, which frequently integrate SHERPA/RoMEO advice into their deposit workflows to prevent authors from infringing copyright agreements.
The indifference of authors towards embargo periods suggests that Elsevier and other major subscription publishers have little incentive to lower embargo periods. While Elsevier has reduced journal embargo periods from time to time, this process has been gradual (Gray, 2018) and approximately one third of Elsevier’s neuroscience journals in the present study had non-compliant embargo periods. However, growth in Elsevier’s compliant subscription journals appears to be slightly better than in their non-compliant range of journals. While non-compliant journals saw little growth in the number of published articles outside of Australia, compliant journals had statistically significant growth in Australia (post-funder policy) and annual growth in Canada and the UK.
The pace of growth in the number of publications for immediate open access journals was higher than growth in subscription journals. Immediate open access neuroscience journals with the DOAJ Seal experienced growth in Australia (post-funder policy), but the increase in publications acknowledging the ARC and NHMRC was not predicted by policy implementation. Canada and the US also experienced annual growth and the rate of open access publishing in the UK was higher post-2013 than pre-2013. These findings suggest that there is an ongoing cultural shift toward open access in neuroscience, but for the most part it does not appear to be associated with funder policy. This is consistent with previous findings that open access publishing is growing its share of biomedical outputs (Laakso & Björk, 2012). However, it may be due to cultural shifts rather than a direct response to funder open access policies.
There was some equivocal evidence that funder open access policies drove growth in the number of publications in OAMJs. While the Australian policy was a predictor of the number of OAMJ papers that acknowledged Australian funders, it was also a predictor of the number of OAMJ papers that acknowledged Canadian funders. In contrast, the Canadian policy was negatively associated with the number of OAMJ papers with Canadian affiliations. Although the data shows clear evidence for growth in the number of neuroscience OAMJ papers between 2010 and 2017, it is confounded by the almost complete lack of funder acknowledgement data for 2010–2012, suggesting that this data was not collected by Scopus.
A gradual cultural shift towards open access explains the persistence of publishing in non-compliant journals, but greater growth in compliant journals and immediate open access journals. Academics in particular sub-fields may experience a degree of lock-in for particular journals because of their importance in their area. Academic journals serve as scholarly certification communities by filtering and curating papers for particular disciplines through peer review and editorial selection, providing quality indicators that are used by research funders and institutions, and disseminating the research findings of authors (Chang, McAleer, & Oxley, 2011; Lindsey, 1976; Prosser, 2003; Suzuki et al., 2016). Publication in particular journals may therefore confer status and prestige that will create opportunities that are not available by publishing in other outlets, even if they require authors to ignore funder policies. While these constraints may prevent non-compliant journals from losing authors, the benefits of open access and a general cultural drive towards open access supports greater growth in open access journals or funder-compliant subscription journals.
In this context, funder open access policies are important even if they are not necessarily driving obvious effects on author choice of journal. Funder policies may provide a signal that normalises open access publishing, even as authors remain ambivalent about copyright (Dodds, 2018) and sceptical of the gold open access business model that has enabled predatory or deceptive publishing (Beall, 2013; Haspelmath, 2013; Shamseer et al., 2017). However, it is clear that funder policies lack the kind of compliance incentives or enforcement mechanisms required to produce obvious effects. For example, compliance with funder open access policies is not explicitly assessed in funding applications and non-compliance incurs no penalties. Institutions also may not have the infrastructure, licensing arrangements, or processes to educate authors and ensure that articles are deposited in repositories (Houghton, 2010; Schmidt & Shearer, 2012). It seems that incentives are of particular importance because even a waiver of publisher embargo did not increase the self-archiving rate of papers in library and information science (Emery, 2018).
The present study was limited to neuroscience journals published by Elsevier, neuroscience journals with the DOAJ Seal, and neuroscience papers in OAMJs. It did not include new prestigious open access journals backed by respected institutions and societies like eLife and eNeuro and we do not consider journal impact factor or other widely used, albeit flawed, quality measures. Meanwhile, the DOAJ Seal journals included publishers that have controversial backgrounds. Both Frontiers and Hindawi have been controversially included on Beall’s list of predatory publishers (Bloudoff-Indelicato, 2015; Butler, 2013) although there may have been subsequent quality improvements (Berger & Cirasella, 2015). An alternative explanation for our findings is therefore that the rise in the number of publications in these journals is not due to funder policy or academic culture in neuroscience shifting towards open access, but is simply due to new major open access publishers becoming established in the field. This possibility is a particularly credible explanation for the growth in OAMJs, which publish articles without consideration to their contribution or novelty (Björk & Catani, 2016). Indeed, commercial publishers freely admit to launching OAMJs in order to raise revenue from articles rejected from their more selective titles (Wakeling et al., 2017), raising the possibility that these articles would not have been published at all if OAMJs did not exist.
Funder open access policies that mandate green open access via self-archiving permit authors to publish in the vast majority of journals from major publishers. However, many Australian and Canadian neuroscientists choose to publish in a subset of Elsevier journals that have embargo periods that are incompatible with the open access policies of major national funders. Dedicated immediate open access journals appear to be growing at a faster rate than Elsevier’s subscription journals, albeit from a low base. These findings demonstrate that funder open access policies may have limited effects beyond assisting cultural trends toward open access without greater institutional support or practical and financial incentives.