Conditional Review Questions

We’ve made an exciting update to the Review Module that now allows conditional questions as part of a custom review form!

What’s a “conditional question”, you might ask? It’s a review question that’s only displayed when a certain condition is met in the proposal being reviewed. For example, if your submission form includes a question for “session type”, with options for “roundtable” and “poster”, you might want reviewers to see one question for roundtables and another question for posters.

Before, the review form had to include both questions with instructions like “If a roundtable…” and “If a poster…”. Now, the Review Module is smart enough to know which question to display based on the answer to the session-type question. In other words, if the proposal is for a roundtable, the reviewer sees the roundtable question; If it’s a poster, the reviewer sees the poster question.

The new feature works with just about any type of question in the submission form. Of course, it works best with questions that have pre-defined answers (radio buttons, checkboxes, and drop-down lists) and not so well with open-ended questions (text, date/time, and file-upload fields).

Give it a try the next time you’re working on your custom review form!

Dashboard Updates

Dashboard ScreenshotJust a quick note to announce some improvements to the Dashboard:

  • Smart Archiving: If you don’t manually archive a call, proposal, or administrative session, the system will automatically archive it for you. (You can still access archived items, they’re just on a separate archive page.) Calls are automatically archived one year after being activated, while proposals and administrative sessions are automatically archived when the call is archived.
  • Additional Details: The call, proposal, and review listings now display the organization(s) responsible for the call, while call and proposal listings now display when they were last edited and by whom.
  • Direct Actions: Select actions for calls and proposals are now available directly from the Dashboard. Key actions, like viewing reviewer comments and managing session materials, are always visible. Secondary actions, like delete and archive, are hidden by default but can be made visible by clicking on a toggle.
  • Call Logos: We’re expanding our branding efforts for calls once again, this time by displaying call logos along with each listing.

We hope everyone likes the changes. If you have any feedback, be sure to let us know!

Layout Improvements for Reviewers

We’re improving the layout of the review page to make it easier than ever to review proposals in ProposalSpace!

Starting Wednesday, July 11, reviewers will no longer see each proposal’s contents displayed in tandem with the review form. Instead, the two will be side-by-side. In case you’re wondering what that looks like, here’s a comparison of the old and new layouts. (Click on a layout for a larger view.)

Old Layout: New Layout:
Old Review Form New Review Form

And here’s a larger view of the new layout with details about specific improvements:

New Review Form1234567

  1. The panels are independently scrollable, so you can navigate to specific areas of the proposal or the review form without one affecting the other.
  2. The panels are resizable. Just slide the divider between them to the left or right.
  3. We’ve removed the “No answer” option for scoring questions. Now, clicking a score once selects it and clicking it again de-selects it.
  4. If the review form has more than one scoring question, each question’s score is displayed to the right and the total score is displayed at the end of the scoring section. (Not shown in this screenshot.)
  5. The Save Review button becomes active only after you’ve made a change to the review form. (If you try to leave the page without saving your review, the system will prompt you to save your work.)
  6. Navigation buttons at the bottom of the page allow you to move to the previous or next proposal in your list of assignments, or to return to your list of assignments.
  7. An indicator across the top of the control bar helps you keep track of your overall progress.

We hope the new layout and functionality will make it even easier for reviewers to complete their work. If you have any suggestions for improvement, please don’t hesitate to contact us or leave a comment below!

New Feature: Review-Chair Submission Approvals

We’ve got another exciting new feature for call admins! Now, you can allow review chairs to approve submissions for review.

ScreenshotPreviously, only call admins could approve submissions. Now, if you would like to delegate that responsibility, just pull up the settings for the review chair (in the appropriate review group) and check the "Allow?" box for the "Approve submissions" setting. (See the screenshot to the right.)

One important thing to keep in mind: Submission fees are paid when proposals are approved for review, so anyone who has permission to approve submissions will be able to charge the submission fees (but nothing else) to the credit card on file.

New Feature: Returned Submissions for Review Chairs

We’ve added a new feature to the Tracker: Now, review chairs can see submissions that have been returned for edits.

Previously, only call admins could see returned submissions. We heard from a call admin, however, that she didn’t want to promote her review chairs to admins just so they could track returned submissions. We thought it was a great idea, so we built it in!

Once again, this shows that the best ideas come from our users. If you’ve got an improvement you would like to see, feel free to pass it along. We’d love to hear it!

Reviewer Conflicts of Interest

We’ve made a few changes to make it easier for reviewers, review chairs, and call admins to identify conflicts of interest.

Although conflicts are not very common (accounting for about 0.1% of reviews in ProposalSpace), we understand that it’s critical for reviewers to be able to flag them clearly as conflicts and for call admins and review chairs to be able to identify them easily.

Previously, the only way for a reviewer to report a conflict was to leave the review unscored and to provide an explanation in the Comments field. This would mark the review as complete, but it wasn’t clear to call admins and review chairs that a conflict had been reported unless they pulled up the review’s details.

Conflict of Interest QuestionTo make it easier for reviewers to clearly report conflicts, we’re adding a checkbox to the review form for every new call (left). Reviewers can still provide details in the Comments field, but if the checkbox is checked, the system disables the scoring option and flags the review as a conflict.

Progress IndicatorFor call admins and review chairs, we changed the way conflicts are displayed throughout the Tracker to make them easier to identify. One way we did this was by adding a progress bar to the In Review page (left) that shows at a glance how many reviewers have scored the submission (green), how many have reported a conflict (yellow), and how many have not yet reviewed it (grey). Hovering over the progress bar displays a summary of the scores, while clicking on it gives access to individual reviews.

Note: The conflict question will only be added automatically to review forms going forward. We can add it manually to any existing review form, however, so feel free to let us know if you would like to use it and we’ll be happy to include it for you!

Think Like Your Attendees

Dave Lutz, over at the Midcourse Corrections blog, lays out six really good ways to improve your conference committee. Here at ProposalSpace, we always try to see things through the eyes of our users, so we especially liked his recommendation to “Walk in the attendee’s shoes”:

Many conference committees evaluate potential sessions and speakers using more information than the attendees will see. Attendees make the decision to attend based on session title, session description, and learning objectives. Embrace a blind review process. It will help eliminate personal agendas and challenge the committee to evaluate the program as a paying attendee would.

New Feature: Late Submissions

Good news, call administrators: You no longer have to re-open a call just to create a late submission. Now, even if your call’s submission deadline has passed, you will continue to see it on the Start a Proposal page.

A few important notes:

  1. Only you and your fellow administrators can see the call on the Start a Proposal page. If you want to allow a non-administrator to start a proposal, you will need to re-open the call.
  2. The call will remain listed on the Start a Proposal page until it is archived.
  3. Proposals you create are attached to your account. If you want to create a proposal on behalf of someone else, you will need to add that person to the proposal so that he/she can have access to it.
  4. Proposals you create after the submission deadline has passed will still need to be approved for review.

New Tutorial: Reviewing Submissions

We’ve just posted a brief tutorial on YouTube that explains how to review submissions in ProposalSpace:http://www.youtube.com/watch?v=QTWIBReUifc. If you manage a call, you might want to have your reviewers view the tutorial before they get started so they know what to expect.

If you have any suggestions for how we can improve the tutorial—or would like to see us create videos for other topics—just let us know!