Tag: Reviewers & Reviews Management

How to enable open review and discussion on assigned abstracts?

One can enable open review so all reviewers can see the reviews submitted on an abstract.

One can also enable open discussion among reviewers so they can discuss the abstract before submitting their reviews.

Go to Abstract settings and enable the following settings as per what you need:

Goal: all reviewers to be able to see all reviews for their assigned abstracts
Enable this setting: Display submitted reviews of the abstract to all assigned reviewers
Goal: all reviewers to be able to participate in discussion for their assigned abstracts
Enable this setting: Enable online discussion for reviewers of the abstract
Goal: reviewers not to see each others’ names when viewing the reviewers or participating in discussion
Disable this setting: Display reviewer’s information to all assigned reviewers of the abstract
Open review settings

How to view the list of abstracts reviewed by a reviewer?

To view the list of abstracts reviewed or not reviewed by a reviewer, you can use the Sort by Review status button.

1. Go to Contacts > Reviewers and search for the reviewer whose reviews you would like to view or simply click on the name of the reviewer. 

2. In Reviewer’s detail view, click on Reviews tab

Notes:

To view list of reviews submitted, use the Sort by review status dropdown and select “Reviewed”. This would return a list of reviewed abstracts. 

Similarly, to view list of reviews not submitted, use the Sort by review status dropdown and select “Not Reviewed”. This would return a list of non-reviewed abstracts.

How to generate a report in Dryfta platform for reviews submitted by reviewers?

Custom reports allow you to have filtered reports letting you choose only what you need. Go to Analytics > Custom reports and look for report “Reviewers and their reviews”. You can edit the report setting to include additional data you want in the report. 

You can also create additional custom reports based on your requirements by clicking on “Create new report” button.

How does Dryfta calculates average rating of an abstract?

Dryfta calculates the average rating of an abstract based on a scale of 10. 

In your abstract management system, admin may have created review questions with different scale for each question. 

So, for example, you have a review question with scale rating from 0 to 5 and another review question with scale rating from 1 to 10. In this scenario, there’s no unique base scale out of which the system should calculate an average rating. 

That’s why the system is hard-coded to generate an average rating on a scale of 10 irrespective of the scale rating that an admin has set for various review questions in the review submission form.

Average rating of an abstract as given by a reviewer

To calculate average rating of an abstract, Dryfta would sum up a reviewer’s ratings for each question (see screenshot) and then multiply it by 2 to generate an average rating of the abstract on a scale of 10, as given by the reviewer.

Final average rating of an abstract

To generate the final score of an abstract, Dryfta would sum up average rating given by each reviewer for the abstract and then divide it by the total number of reviewers who reviewed the abstract. This generates the abstract’s final score on a scale of 10. See screenshot.