The current psychological discourse about transparency and openness (“reproducibility crisisâ€) still lacks of instruments. Furthermore, computer-based tests have often strict copyright licenses or are simple paper-pencil adaptions. To bridge this gap, we introduce COMPROSO—an Open Source web-based software framework for behavioral assessments providing additional benefits over currently available solutions.

Web-based testing should provide scholars with the opportunity to share and reintegrate whole tests or single scales in their projects, as well as sharing testing data with others. In addition, it requires—besides privacy, transparency, and versatility—an accessible, scalable, and extensible tool. Hence, a software achieving this, should require an Open Source license, strong modularization and enough versatility for even future tests.

Therefore, we designed COMPROSO as a web-based software framework with low system requirements for the server. Tests are optionally included as single (extension) packages. More usual tests can be easily implemented with templates provided. Concurrently, COMPROSO stays flexible enough to include innovative and more complicated or even future features.

Currently, several test authors provided their tests within the COMPROSO framework, including performance and personality test scales in English and German. Not all of them are Open Source (or the like) licensed. But we ensured them to be free of charge for scientific purposes. We will demonstrate the operationality of COMPROSO by presenting implementation, administration, management of performance and personality tests.

COMPROSO is a proof of concept that psychological assessment, more specifically web-based assessment can be conducted with a consideration of the Open Science idea creating a fruitful synergy for the field of assessment. Furthermore, transparent data collection and management is feasible. As COMPROSO is modularized, its extensibility is only limited to programmable web-based features. We would like to invite the scientific community to participate in the project.