Layout Improvements for Reviewers

We’re improving the layout of the review page to make it easier than ever to review proposals in ProposalSpace!

Starting Wednesday, July 11, reviewers will no longer see each proposal’s contents displayed in tandem with the review form. Instead, the two will be side-by-side. In case you’re wondering what that looks like, here’s a comparison of the old and new layouts. (Click on a layout for a larger view.)

Old Layout: New Layout:
Old Review Form New Review Form

And here’s a larger view of the new layout with details about specific improvements:

New Review Form1234567

  1. The panels are independently scrollable, so you can navigate to specific areas of the proposal or the review form without one affecting the other.
  2. The panels are resizable. Just slide the divider between them to the left or right.
  3. We’ve removed the “No answer” option for scoring questions. Now, clicking a score once selects it and clicking it again de-selects it.
  4. If the review form has more than one scoring question, each question’s score is displayed to the right and the total score is displayed at the end of the scoring section. (Not shown in this screenshot.)
  5. The Save Review button becomes active only after you’ve made a change to the review form. (If you try to leave the page without saving your review, the system will prompt you to save your work.)
  6. Navigation buttons at the bottom of the page allow you to move to the previous or next proposal in your list of assignments, or to return to your list of assignments.
  7. An indicator across the top of the control bar helps you keep track of your overall progress.

We hope the new layout and functionality will make it even easier for reviewers to complete their work. If you have any suggestions for improvement, please don’t hesitate to contact us or leave a comment below!

New Feature: Review-Chair Submission Approvals

We’ve got another exciting new feature for call admins! Now, you can allow review chairs to approve submissions for review.

ScreenshotPreviously, only call admins could approve submissions. Now, if you would like to delegate that responsibility, just pull up the settings for the review chair (in the appropriate review group) and check the "Allow?" box for the "Approve submissions" setting. (See the screenshot to the right.)

One important thing to keep in mind: Submission fees are paid when proposals are approved for review, so anyone who has permission to approve submissions will be able to charge the submission fees (but nothing else) to the credit card on file.

New Feature: Returned Submissions for Review Chairs

We’ve added a new feature to the Tracker: Now, review chairs can see submissions that have been returned for edits.

Previously, only call admins could see returned submissions. We heard from a call admin, however, that she didn’t want to promote her review chairs to admins just so they could track returned submissions. We thought it was a great idea, so we built it in!

Once again, this shows that the best ideas come from our users. If you’ve got an improvement you would like to see, feel free to pass it along. We’d love to hear it!

Reviewer Conflicts of Interest

We’ve made a few changes to make it easier for reviewers, review chairs, and call admins to identify conflicts of interest.

Although conflicts are not very common (accounting for about 0.1% of reviews in ProposalSpace), we understand that it’s critical for reviewers to be able to flag them clearly as conflicts and for call admins and review chairs to be able to identify them easily.

Previously, the only way for a reviewer to report a conflict was to leave the review unscored and to provide an explanation in the Comments field. This would mark the review as complete, but it wasn’t clear to call admins and review chairs that a conflict had been reported unless they pulled up the review’s details.

Conflict of Interest QuestionTo make it easier for reviewers to clearly report conflicts, we’re adding a checkbox to the review form for every new call (left). Reviewers can still provide details in the Comments field, but if the checkbox is checked, the system disables the scoring option and flags the review as a conflict.

Progress IndicatorFor call admins and review chairs, we changed the way conflicts are displayed throughout the Tracker to make them easier to identify. One way we did this was by adding a progress bar to the In Review page (left) that shows at a glance how many reviewers have scored the submission (green), how many have reported a conflict (yellow), and how many have not yet reviewed it (grey). Hovering over the progress bar displays a summary of the scores, while clicking on it gives access to individual reviews.

Note: The conflict question will only be added automatically to review forms going forward. We can add it manually to any existing review form, however, so feel free to let us know if you would like to use it and we’ll be happy to include it for you!

Think Like Your Attendees

Dave Lutz, over at the Midcourse Corrections blog, lays out six really good ways to improve your conference committee. Here at ProposalSpace, we always try to see things through the eyes of our users, so we especially liked his recommendation to “Walk in the attendee’s shoes”:

Many conference committees evaluate potential sessions and speakers using more information than the attendees will see. Attendees make the decision to attend based on session title, session description, and learning objectives. Embrace a blind review process. It will help eliminate personal agendas and challenge the committee to evaluate the program as a paying attendee would.

New Feature: Late Submissions

Good news, call administrators: You no longer have to re-open a call just to create a late submission. Now, even if your call’s submission deadline has passed, you will continue to see it on the Start a Proposal page.

A few important notes:

  1. Only you and your fellow administrators can see the call on the Start a Proposal page. If you want to allow a non-administrator to start a proposal, you will need to re-open the call.
  2. The call will remain listed on the Start a Proposal page until it is archived.
  3. Proposals you create are attached to your account. If you want to create a proposal on behalf of someone else, you will need to add that person to the proposal so that he/she can have access to it.
  4. Proposals you create after the submission deadline has passed will still need to be approved for review.

New Tutorial: Reviewing Submissions

We’ve just posted a brief tutorial on YouTube that explains how to review submissions in ProposalSpace:http://www.youtube.com/watch?v=QTWIBReUifc. If you manage a call, you might want to have your reviewers view the tutorial before they get started so they know what to expect.

If you have any suggestions for how we can improve the tutorial—or would like to see us create videos for other topics—just let us know!

Where Is My Logout Button?  

Some of you may have noticed some changes to the design of the site. We’ve been working on new features and needed a little extra “real estate” in order to keep things from becoming overcrowded. Plus, the average size of monitors (even on laptops) has continued to increase, so why leave all that extra white space unused?

For details about what got moved where, see our Design Notes.

Review Groups Are Here!

A lot of conferences—especially larger ones—need to split up their review tasks among different groups of reviewers. Up to now, the only way to do that in ProposalSpace was to set up multiple calls, each with its own set of reviewers. Now, call administrators can manage multiple sets of reviewers in a single call!

Our new Review Groups feature lets call administrators set up an unlimited number of groups and assign an unlimited number of submissions, review chairs, and reviewers to each one.

Say, for instance, that your call asks each author to select one of five topic areas. Previously, if you wanted to assign a different set of reviewers to each topic area that meant you had to set up five calls. Now, you can just create five review groups within a single call (one for each topic area), then assign submissions, review chairs and reviewers to one or more of the groups. Permissions are based on the review group, so a review chair may only work within his/her assigned group. Call administrators, of course, can work within any group.