Open Research Tools and Technologies

On the dissemination/evaluation loop for Research Software

D.research
Teresa Gomez-Diaz
<p>This talk explores the interconnections that links Research Software (RS) dissemination and evaluation issues, in the Open Science context, following the guidelines of the CDUR RS assessment protocol.</p>
In our presentation of FOSDEM 2021 Free/Open source Research Software production at the Gaspard-Monge Computer Science laboratory - Lessons learnt https://archive.fosdem.org/2021/schedule/event/openresearchgaspard_monge/ we have analyzed the evolution of several problems that rise when considering the Research Software (RS) production of a laboratory, and we have highlighted several issues that should be addressed to deal with these problems within the Open Science context. Among them we have called to the establishment of sound dissemination and evaluation procedures following the guidelines of the CDUR RS assessment protocol presented in Gomez-Diaz T and Recio T. On the evaluation of research software: the CDUR procedure. F1000Research 2019, 8:1353 (https://doi.org/10.12688/f1000research.19994.2) CDUR comprises four steps that can be succinctly described as follows: - Citation, to deal with correct RS identification, - Dissemination, to measure good dissemination practices, - Use, devoted to the evaluation of usability aspects, and - Research, to assess the impact of the scientific work. In this talk we would like to analyze more in depth RS dissemination and evaluation issues and the above mentioned protocols, referring, in particular, to how these protocols can be adapted to different situations that may appear in evaluation processes such as, for example, different evaluation contexts (career, review...). We will also highlight the interconnections that link both dissemination and evaluation issues, as the RS dissemination needs to adjust to evaluation rules and only suitably disseminated RS (maybe in a restricted context) can be evaluated. This is a collaboration work with Tomas Recio, Professor at the University Nebrija (Madrid).

Additional information

Type devroom

More sessions

2/5/22
Open Research Tools and Technologies
D.research
<p>The Open Research Tools and Technologies devroom managers welcome words announcing the schedule.</p>
2/5/22
Open Research Tools and Technologies
Ian Johnson
D.research
<p>This presentation is about the development and trajectory of Heurist (HeuristNetwork.org), a shared, integrated, extensible data infrastructure (model, build, manage, analyse, visualise, share, publish via integrated CMS) for Humanities research capable of handling the needs of many heterogeneous projects on a single standalone service*, with optional integration across multiple servers by a coordinating index (itself based on Heurist).</p> <p>Humanities data are interesting (both technically ...
2/5/22
Open Research Tools and Technologies
D.research
<p>Developed from 1995 onward, Prospero is a framework for longitudinal analysis of text corpora. Based on dictionaries and semi-automatic classification, it mainly allows its user to combine approaches of statistical computation, co-occurrence network and search for nested patterns. Inspired by pragmatic sociology, it focuses on the multiple forms of expression and argumentation used by actors, on language regimes and on the identification of transformations occurring in the research case. ...
2/5/22
Open Research Tools and Technologies
John Boy
D.research
<p>I am a social scientist who mostly teaches and conducts qualitative research, but I am also a programmer. Over the years, I have contributed to a variety of free and open source software projects, and since 2019, I have developed and maintained <code>textnets</code>, a Python package for text analysis that represents collections of texts as networks of documents and words, providing novel possibilities for the visualization and analysis of texts. In my field, such software development efforts ...
2/5/22
Open Research Tools and Technologies
D.research
<p>Discussion panel of three testimonies from academics developing software.</p>
2/5/22
Open Research Tools and Technologies
Robin De Mourat
D.research
<p>The writing of web publications mixing data visualization and textual prose opens novel opportunities for connecting evidence, arguments and narrative in social sciences communities. Such a practice poses a variety of challenges in terms of website design and development ; but also and maybe more importantly, it asks for experimenting specific workflows for coordinating a variety of expertises ranging from social sciences disciplines (history, sociology, etc.) to data science, information ...
2/5/22
Open Research Tools and Technologies
Evgeny Karev
D.research
<p>This talk will show a new Python tool called Livemark, which is designed for data journalism software education, and documentation writing. Using Livemark, you can collect and present data with interactive tables, charts, and other elements without leaving a text editor. You can also write documentation with live script execution similar to a lightweight version of a Jupiter Notebook. This talk will demo Livemark and will be well-suited for a technical and non-technical audience that is ...