class: center, middle, inverse, title-slide .title[ # A few things about open and reproducible research… . ] .author[ ### Prof. Thomas Pollet, Northumbria University (
thomas.pollet@northumbria.ac.uk
) ] .date[ ### 2025-05-06 |
disclaimer
] ---
## Who am I? * trained in Sociology (Ghent) --> Evolutionary Psychology (Liverpool, NCL). -- * worked in Social Psychology depts. in Netherlands (Groningen, VU Amsterdam, Leiden) -- * Now at Northumbria University (dept. of Psychology, since 2017) - I was UKRN institution lead at Northumbria University - up until 2024 --> Prof. Matt Baillie Smith & Prof. Louise Bracken <img src="https://media.giphy.com/media/C7olQswvzSwAE/giphy.gif" width="400px" style="display: block; margin: auto;" /> ??? IL: 'Top Down': 'Senior management'; I meet with and develop policy with UKRN, promote UKRN, liaise with PVC on UKRN goals, and deliver training - I am independent from Local Network Lead (and technically this role is also independent from the University) --- ## Recent history * Why care about reproducibility and open research practices... . -- * I was there when it happened -- sort of ... . -- * Similar to Erdős number: --> Stapel = 2; Förster = 2; Smeesters = 2; Wansink = 2; Gino = 2;... <img src="this_is_fine.jpg" width="400px" style="display: block; margin: auto;" /> --- ## Things need to change... . * Witnessed poor practices first hand. -- * Witnessed a lot of waste... . -- * Interaction with other disciplines: Anthropology, Economics, Sociology,... . <img src="https://media.giphy.com/media/BMXOmkI9ocLntJs5XJ/giphy.gif" width="400px" style="display: block; margin: auto;" /> ??? - Lab meeting. 1 in 20 significant --- ## Some background reading * <a name=cite-Goldacre2009></a><a name=cite-Goldacre2014></a>[Goldacre and Farley (2009)](#bib-Goldacre2009); [Goldacre (2014)](#bib-Goldacre2014) : Bad Science / Bad Pharma * <a name=cite-Chambers2017></a>[Chambers (2017)](#bib-Chambers2017) : Seven deadly sins * <a name=cite-Ritchie2020></a>[Ritchie (2020)](#bib-Ritchie2020) : Science fictions * [Daniel Nettle's blog](https://www.danielnettle.org.uk/) <img src="https://media.giphy.com/media/34ZNcoaN5u4hi/giphy.gif" width="400px" style="display: block; margin: auto;" /> --- ## What are Open Research Practices? * An umbrella term for many practices. Often linked with other domains of 'good' research practices: Research Integrity, Research ethics, Digitisation, Research culture -- * Tend to have aims of making our work more: - **Accessible.** e.g., articles/books open access. Allowing others to re-use your research. - **Reproducible.** Being more transparent about your research process. Using tools/resources that are open access, which allow others to reproduce your findings. - **Replicable (?).** Increasing likelihood of someone finding the same effect. -- <img src="adam-savage-mythbusters.gif" width="300px" style="display: block; margin: auto;" /> --- ## Why are these practices useful to us? * Cynically: In everybody's self-interest everybody should engage with these. * Open Research is the Future: More journals, funders, universities etc. will have requirements. * Developing these practices and having a track record --> **Smart Move.** <img src="Cynic.gif" width="300px" style="display: block; margin: auto;" /> --- ## Less cynically ... . * Engaging in these practices --> ‘The Right Thing To Do’. -- * Adopting open research practices means developing a more robust evidence base for our research. -- * Sharing our knowledge more effectively. --- ## UKRN * First joined as Local Network Lead (now David Smailes). -- * Formally joined [UKRN](https://www.ukrn.org/2021/08/13/northumbria-joins-uk-reproducibility-network/) in August 2021. We also joined the Open Research Programme. <img src="UKRN_Logo.png" width="400px" style="display: block; margin: auto;" /> --- ## UKRN The following is based on [UKRN's resources](https://www.ukrn.org/resources/), specifically this [one](https://osf.io/x923p). -- For the UK research system to be outstanding in conducting and promoting rigorous and transparent research. The purpose of the UK Reproducibility Network (UKRN) is to enable researchers, institutions, and other stakeholders working in the UK to collaborate, so they are better able to **conduct and promote rigorous, reproducible, and transparent research.** -- This includes: - identifying the factors that affect research rigour and transparency; - identifying, sharing, and integrating effective practice; - supporting a culture of continual improvement; - providing training and support; coordinating action; - supporting inter- and trans-disciplinary research; - influencing actors across the research system; - and offering constructive challenge. --- ## UKRN: Distribution (Jan. 10th 2024) <img src="UKRN_distribution.png" width="600px" style="display: block; margin: auto;" /> ??? Equivalent RNs : Belgium, Switzerland, to name a few. --- ## UKRN: stakeholders [https://www.ukrn.org/stakeholders/](https://www.ukrn.org/stakeholders/) <img src="stakeholders.jpg" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: Growth <img src="UKRN_growth.png" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: Implement Change <img src="UKRN_change.png" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: Mechanisms <img src="UKRN_mechanism.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Open research programme <img src="UKRN_ORP_outline.png" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: Open research programme and UKRN community <img src="UKRN_ORP_Relation.png" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: ORP change <img src="UKRN_ORP_Change.png" width="600px" style="display: block; margin: auto;" /> --- ## UKRN: ORP Training <img src="UKRN_ORP_Training.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: ORP Hiring and promotion <img src="UKRN_ORP_OR4.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: ORP Indicators <img src="UKRN_ORP_indicators.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: How do we achieve change? <img src="UKRN_support_research_culture.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Beyond disciplinary boundaries <img src="UKRN_beyond_boundaries.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Research culture <img src="UKRN_Research_culture.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Resources <img src="UKRN_generating_resources.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: dissemination <img src="UKRN_dissemination.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Reproducibility <img src="UKRN_Reproducibility.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Culture change <img src="UKRN_culture_change.png" width="800px" style="display: block; margin: auto;" /> --- ## UKRN: Culture change: Who? <img src="UKRN_culture_change_who.png" width="800px" style="display: block; margin: auto;" /> --- ## Summary - Brief overview - UKRN as organisation - goals and some projects <img src="https://media.giphy.com/media/dsKnRuALlWsZG/giphy.gif" width="400px" style="display: block; margin: auto;" /> --- ## Additional Resources [https://osf.io/x8j9q/wiki/home/](https://osf.io/x8j9q/wiki/home/) [https://www.youtube.com/channel/UC_gar6y864eLGfX7zJSWd5w/featured](https://www.youtube.com/channel/UC_gar6y864eLGfX7zJSWd5w/featured) -- * Preprints -- * Data sharing -- * Open Access -- * Open code + Software -- * Pre-registration / Registered reports <img src="https://media.giphy.com/media/vgsj2QCJGv7Xi/giphy.gif" width="300px" style="display: block; margin: auto;" /> --- ## Other things to mention / check out... * [Octopus](www.octopus.ac) -- * [DORA](https://sfdora.org/) --- ## What might the future hold? * Open research will become the norm ?! -- * Team Science? <img src="https://media.giphy.com/media/xUPGcjQ6dJEjH5uwMw/giphy-downsized-large.gif" width="400px" style="display: block; margin: auto;" /> --- ## Any Questions? [http://tvpollet.github.io](http://tvpollet.github.io) BlueSky: @tvpollet.bsky.social <img src="https://media.giphy.com/media/3ohzdRoOp1FUYbtGDu/giphy.gif" width="400px" style="display: block; margin: auto;" /> --- ## Activity * Look at some aspects where you could implement open research practices in your research? * It is a buffet. (Preprint, pre-registration, data sharing, code sharing, open source usage). Look at some of UKRN's resources? * Discuss in pairs? --> alternatively sort of 'ask me anything'. --- ## Acknowledgments I am greatly indebted to my colleagues who helped me along the way and UKRN (Any mistakes are my own). This talk is based on [https://osf.io/x923p](https://osf.io/x923p) and some slides by David Smailes. Slides were built with [Xaringan](https://github.com/yihui/xaringan) and [XaringanExtra](https://pkg.garrickadenbuie.com/xaringanExtra/). Many thanks to those building packages and supporting the [R](https://www.r-project.org/) eco-system. You for listening! <img src="https://media.giphy.com/media/10avZ0rqdGFyfu/giphy.gif" width="400px" style="display: block; margin: auto;" /> --- ## References and further reading (errors = blame RefManageR) <a name=bib-Chambers2017></a>[Chambers, C.](#cite-Chambers2017) (2017). _The Seven Deadly Sins of Psychology A Manifesto for Reforming the Culture of Scientific Practice_. Princeton, NJ: Princeton University Press. <a name=bib-Goldacre2014></a>[Goldacre, B.](#cite-Goldacre2014) (2014). _Bad Pharma: How Drug Companies Mislead Doctors and Harm Patients_. Macmillan. ISBN: 0-86547-806-6. <a name=bib-Goldacre2009></a>[Goldacre, B. and R. Farley](#cite-Goldacre2009) (2009). _Bad Science_. Fourth Estate London. ISBN: 0-00-728487-X. <a name=bib-Munafo2014></a>[Munafò, M., S. Noble, W. J. Browne, et al.](#cite-Munafo2014) (2014). "Scientific Rigor and the Art of Motorcycle Maintenance". In: _Nature Biotechnology_ 32.9, pp. 871-873. ISSN: 1546-1696. DOI: [10.1038/nbt.3004](https://doi.org/10.1038%2Fnbt.3004). <a name=bib-Ritchie2020></a>[Ritchie, S.](#cite-Ritchie2020) (2020). _Science Fictions: Exposing Fraud, Bias, Negligence and Hype in Science_. New York, NY: Random House. ISBN: 1-4735-6425-5.