Open research projects

class: center, middle, inverse, title-slide

.title[
# Open research projects
]
.author[
### Prof. Dr. Thomas Pollet, Northumbria University (<a href="mailto:thomas.pollet@northumbria.ac.uk" class="email">thomas.pollet@northumbria.ac.uk</a>)
]
.date[
### 2023-11-16 | <a href="http://tvpollet.github.io/disclaimer">disclaimer</a>
]

---

<div>
<style type="text/css">.xaringan-extra-logo {
width: 110px;
height: 128px;
z-index: 0;
background-image: url(NU2.png);
background-size: contain;
background-repeat: no-repeat;
position: absolute;
top:1em;right:1em;
}
</style>
<script>(function () {
  let tries = 0
  function addLogo () {
    if (typeof slideshow === 'undefined') {
      tries += 1
      if (tries < 10) {
        setTimeout(addLogo, 100)
      }
    } else {
      document.querySelectorAll('.remark-slide-content:not(.title-slide):not(.inverse):not(.hide_logo)')
        .forEach(function (slide) {
          const logo = document.createElement('div')
          logo.classList = 'xaringan-extra-logo'
          logo.href = null
          slide.appendChild(logo)
        })
    }
  }
  document.addEventListener('DOMContentLoaded', addLogo)
})()</script>
</div>

## Outline

* Two projects
* One project in more detail

---
## RIS internal Funding

* 'Biblionetrics' project (C. Malcolm, L. Maughan)

* Open Research Practices and internal REF ratings (A. Anguera de la Rosa, T. Fitzpatrick, C. Malcolm, M. Smith, I. Sutcliffe)

---
## Biblionetrics

* Identify where we publish open access, who are the most prolific authors? And general bibliometric stuff (2022:2023, >1,300 papers, 770 documents 'Green')

* Close but no cigar: 'citedness' (logit .327 +/- .169, _z_ = 1.94, _p_ = .052 -- Odds ratio of around 1.39)

* Everything is [here](https://connmal.github.io/Bibliometrix_Northumbria/About.html). Including some network graphs.

---
## Example: word cloud

---
## Open Research and REF

* Two independent coders. Very first batch of our internal REF scoring exercise (two raters and moderated score).

* Coding scheme developed by Norris et al. (2022).<sup>1<sup>

* 15 practices (e.g., pre-registration available, data available). Generated a count variable.

* There was near perfect consistency and the coders met and resolved any discrepancies. **Liberal** coding... .

* Reviewer scores 12 point scale (1- → 1 … 4+ → 12). U's excluded (7 - all from psych.).

.footnote[
[1] Norris, E., Sulevani, I., Finnerty, A. N., & Castro, O. (2022). Assessing Open Science practices in physical activity behaviour change intervention evaluations. BMJ Open Sport & Exercise Medicine, 8(2), e001282. [https://doi.org/10.1136/bmjsem-2021-001282](https://doi.org/10.1136/bmjsem-2021-001282)
]

???
Note the limitations of creating a count score.

---
## Descriptive statistics

* 67 psychology papers / 17 applied sciences paper.

* Tables. [Individual Practices](Practice.html) and [OR count / Final Score](OR_count_final_Ref_score_table.html).

---
## Bar chart

---
### Does frequency of OR practices differ between groups?

* Ordinal logistic regression analysis.

* The groups did not significantly differ (Coefficient = 0.5679+/-0.4396, _z_ = 1.292, _p_ = .196). (but small n)

---
### Associations between OR count and final score

* **Overall**: Somers Dyx : .18, 95% CI .03 to .34.<sup>2<sup>

* **Breakdown by discipline**:  Driven by psychology (.27, 95% CI: .10 to 0.43) - if anything the relationship was _negative_ in AS (-.07, 95% CI: -0.57 to .43).

* **Psychology: Breakdown by reviewer**: the association was only reliably present in one of the two reviewers (Reviewer 1 = .09, 95% CI -0.07 to .24; Reviewer 2 = .32, 95% CI = .15 to .48)

.footnote[
[2] Somers, R. H. (1962). A New Asymmetric Measure of Association for Ordinal Variables. American Sociological Review, 27(6), 799–811. https://doi.org/10.2307/209040
]

---
## Associations between a given OR practice and final score.

* [Big table](Overall_R1_R2.html)

---
### Many limitations...

* Scheme not apt for AS? Perhaps note even apt for psychology?

* Small numbers... .

* So many more... .

---
## Any Questions?

[http://tvpollet.github.io](http://tvpollet.github.io)

These slides: [https://tvpollet.github.io/open_res_11_23/talk_open_res_11_23.html](https://tvpollet.github.io/open_res_11_23/talk_open_res_11_23.html#1)

---
## Acknowledgments

* I am indebted to everyone who helped me with these projects.

* The slides were created in [RMarkdown](https://rmarkdown.rstudio.com/) with the [xaringan](https://github.com/yihui/xaringan) package.

* You for listening!

---
## Some resources

* [www.ukrn.org](www.ukrn.org)
* [RepoducibiliTea](https://reproducibilitea.org/)
* [Center for Open Science](https://www.cos.io/?hsLang=en)
* [UKRI](https://www.ukri.org/about-us/policies-standards-and-data/good-research-resource-hub/open-research/)
* [Registered Reports](https://www.cos.io/initiatives/registered-reports)