23
U.S. Department of Health and Human Services Health Resources and Services Administration APPLICATION REVIEW MODULE (ARM) Division of Nursing and Public Health Reviewers Manual
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION REVIEW MODULE (ARM)Division of Nursing and Public HealthReviewers Manual
U.S. Department of Health and Human Services
Health Resources and Services Administration
ABOU
T ARMAbout ARM
Once you have read and considered each application, ARM is the web-based computer system you will use to record the results of your evaluations. It provides a user-friendly environment to facilitate the HRSA/DNPH application review process while allowing reviewers to participate from remote locations.
The users of ARM that are discussed in this material are the Reviewer and the Review Administrator (RA).
2
U.S. Department of Health and Human Services
Health Resources and Services Administration
ACCESSING
ARM1. Log-in under the “Reviewer Logon” tab at the top.
2. Click in or Tab to User Name and enter your username and then to Password and enter your password into the appropriate boxes. Then click the button. Note: Usernames and Passwords are case sensitive.
Each review in ARM has a unique Session ID. You may be a reviewer on more than one active review. Your Username and Password will provide you access to any active review to which you have been assigned.
Accessing ARM
You will receive an email prior to your review containing your Username and Password as well as the link to the ARM website.
3
U.S. Department of Health and Human Services
Health Resources and Services Administration
STARTING
THE REVIEW
Accessing Your Review
2. Find the Session ID or Session Name that matches the review you will be working on and click on the hyperlinked Session Name.
3. Click on the hyperlinked panel number to select your panel.
4
U.S. Department of Health and Human Services
Health Resources and Services Administration
STARTING
THE REVIEW
Application Selection Screen
4. Click on the hyperlinked Application Name to advance to the Application Worksheet Screen and begin your review.
Note: In the score column, if the score shown is -- you have not entered any scores for this application. If an “*” is present next to the score, you have not entered all of the individual scores required for this application.
Application ID Status Score Application Name
If there are no applications listed, please contact your HRSA/DNPH review administrator.
This screen displays four major identifiers of the application.
5
U.S. Department of Health and Human Services
Health Resources and Services Administration 6
View Application PDF File
*Note: In most cases, the link will read Open PDF. This means the file has been retrieved and is ready to be opened. If the link reads Retrieve PDF, the file has not been transferred to the ARM system. Simply click on the Retrieve PDF link to transfer the file into the ARM system. Once the PDF file has been brought over to the ARM system, the link will read Open PDF.
In situations where the application PDF file feature is turned on, the Reviewers will be able to view the application PDF file through the ARM system.
6
View Application PDF File
1. Click on the Open PDF link to open the application PDF file. The file will open in a new window. You can also save this file for viewing at a later time.
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCREENThis screen serves as the primary control panel for evaluating that particular application. All applications will be scored by individual criterion.
Application Worksheet Screen
The scoring criteria are listed in the first column.
The middle column is where you will click to enter your scores. The score will automatically total as you move through the criteria.
The last column is where you will be able to click and enter comments after you have entered scores.
7
)
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCORIN
GApplication ScoringFirst, users must enter a score BEFORE any comments can be entered.
Note: You will not be able to select a score greater than the maximum defined by the criterion.
5. In the Score column, click on the hyperlinked -- to begin scoring the application.
6. Using the drop-down arrow, select the appropriate score by clicking on the number.
7. Click .
8
Note: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCORIN
GNote: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
Entering Comments
ONLY AFTER YOU ASSIGN A SCORE to an individual criterion can you include corresponding comments.
Note: If you have not entered all required scores for an application, your Actual Score will be followed by an * indicating that your scoring is not complete.
Again, as seen in the image, the only activated Comment links are those with a corresponding score. The link will automatically appear once you have scored the criterion.
9
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
COM
MEN
TSEntering Comments
Clicking the Comment link will open the Comments window.
9. Click on the drop-down arrow to open the menu. Select whether you are describing a Strength or Weakness.
10. Enter a page number or any page identifying information.
Note: All fields in this screen are required.
11. Enter your strength or weakness. You can type directly into this field or copy and paste from a word processing program. After entering the comment, it is strongly recommended that you Spell Check your work by clicking on the Spell Check button.
12. Click to save your comment as part of your evaluation.
10
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
COM
MEN
TSEntering Multiple Comments
You can enter multiple strengths or weaknesses for each criterion.
To enter multiple comments, repeat steps 9-12.
All previous comments will be visible toward the bottom of the page, below the “Add a New Comment” box.
Regardless of the order in which they were entered, comments will group by category (Strength or Weakness).
11
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
COM
MEN
TSEditing Comments
You can edit your saved comments at any time.
Deleting Comments Click Delete to permanently remove a comment from your evaluation.
To edit your comments, click on the word Edit next to the comment number you would like to change.
Clicking on the Edit link will open the comment window and you will be able to edit your content. When complete click to save your changes.
12
U.S. Department of Health and Human Services
Health Resources and Services Administration
SESSION
TIME-O
UTS AN
D PREVEN
TING
DATA LO
SSSession Time Out
After 30 minutes, if you are not clicking between ARM web pages, you will be logged out and required to re-enter your username and password. Any comments that have not been saved will be lost.
Note: The comment window has a countdown timer (circled above). This timer will let you know how much time remains in your session and will read “Timeout” when time expires.
Save Your Work
To save your comments as you work, you can periodically click the button. This button will save your comments, and you can easily edit them to make additions or changes.
13
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCORIN
GCompleted Comments
Once you have finished entering all of your comments for a given criterion, you will need to return to the Application Worksheet Screen.
13. Click on the hyperlinked word Evaluation in the bar at the top of your screen to return to the Application Worksheet Screen after you have included all comments for a given criterion.
14
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCORIN
GNote: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
Application Worksheet Screen
After returning to this screen continue entering comments for the remaining criteria as needed.
Repeat steps 8-12 to add comments for each criterion
15
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
EVALUATIO
N
SCORIN
GNote: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
Entering Multiple Scores At Once
If you would like to enter all of your scores at one time, click on the hyperlinked column header Score.
The full Add Scores screen will open, and you will be able to click on the drop-down arrow for each criterion and assign a score.
When you have entered all of the scores, click .
16
U.S. Department of Health and Human Services
Health Resources and Services Administration
SCORIN
G REPO
RTSNote: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
Reviewing your Work
You can review your work at any time in the process.
To view all of your strengths and weaknesses for each criterion, click . Click to view your entries for all other sections. Each of these views open in a new window and show information for that individual application, and each view can be printed as a report.
To view your scores by criterion, you can click the at any time. The view will open in a new window from which you can also print the view as a report.
17
U.S. Department of Health and Human Services
Health Resources and Services Administration
SUBM
IT REVIEW
Note: The Submit to Chairperson button will not be activated until ALL scores have been entered.
Note: Once you submit your application evaluation to your RA, further edits CANNOT be made.
Submitting Your ReviewWhen you have completed scoring the application and are satisfied with your comments, you will need to submit your evaluation to your RA.
26. Click the button to submit your application evaluation to your RA.
27. Click OK in the confirmation box to finalize your submission.
18
The button will not be activated until all sections are completed.
To evaluate other assigned applications, click “Applications List” located on the blue tool bar at the top of the page.
When all applications have been evaluated and submitted to the chair, log-off of the system.
Note: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
U.S. Department of Health and Human Services
Health Resources and Services Administration
SCORIN
G AN
D D
OCU
MEN
TS RULES
You can only see your own scores and comments. You must enter a score for each criterion BEFORE proceeding to enter strengths and
weaknesses. The Comments link will be automatically activated after you enter a value in the score field.
The button does not become active until the your review of an application is complete. You cannot submit your review to the RA until you have scored all criteria and comments.
You cannot change or modify your scores, strengths and weaknesses once an application has been submitted to the RA. You can, however, still view and print your own scores, comments and entries to other sections.
All Fields marked with an asterisk * are mandatory. If the Back Arrow or the blue Navigation Bar are available, use one or the other to
navigate within ARM. Only close a window when neither the Back Arrow or Navigation Bar are available.
Exit ARM by clicking on Logon on/off in the upper right corner or your screen.
Application Worksheet Rules
19
U.S. Department of Health and Human Services
Health Resources and Services Administration
APPLICATION
STATUS D
EFINITIO
NS
When an application has been assigned and is available to you to enter criteria scores, strengths, and weaknesses that application’s status is In Review.
When you finish entering all your scores, strengths and weaknesses, you can click the button and that application’s status changes to Submitted to Chair.
(Web-Assisted Teleconference Only) When the panel has reached consensus and the RA has recorded all of the panels recommendations regarding strengths and weaknesses, the RA will return control to all reviewers on the panel so that they may enter or modify their scores for each criteria. That application’s status is then changed to Returned by RA. Once each reviewer has entered, changed, or decided to leave his or her scores unchanged, they will again click the button, and that application’s status once again becomes Submitted to Chair.
20
U.S. Department of Health and Human Services
Health Resources and Services Administration
RETURN
ED APPLICATIO
NS
Entering or Modifying Your Final Scores
After your panel finishes their discussion of a score discrepancy application, your RA will return the application to you so you can enter or modify your scores.
You will know if an application has been returned to you because the status on your Application Selection Screen will read “Returned by Chair”.
28. To begin the process of modifying or entering your score for an application, click on the Application Name, as you did in Step 3, to open the Application Worksheet Screen.
21
U.S. Department of Health and Human Services
Health Resources and Services Administration
REVISE APPLICATION
EVALUATIO
N
To change or enter a criterion score, clickthe applicable Score link.When you have finished updating orentering , click to send yourevaluation back to the RA.
Revising Your Evaluation
At the direction of your Chairperson and based on your panel discussions, you will enter or modify your scores.
Note: Once you re-submit, you will no longer have access to the Return History screen from this screen.
22
Note: Reviewer will view criteria pertinent to the Nursing Scholarship Program. Criteria will be similar to the screenshot on page 7.
U.S. Department of Health and Human Services
Health Resources and Services Administration
ENDPlease follow the instructions in this manual to
process all the applications on your panel. If you have technical questions, please contact the HRSA ARM Technical Assistance Team at [email protected]
If you have NSP questions, please email [email protected] or call:Arthur Williams, Senior Public Health Analyst 301-443-9182Dustin Price, Public Health Analyst 301-443-4874Kamu Aysola, Management Analyst 301-443-5217
23
