Date post: | 22-Dec-2015 |
Category: |
Documents |
Upload: | willa-shepherd |
View: | 223 times |
Download: | 1 times |
1
School Core Professional Developmentfor Teachers
2
Have You
Clicked on: Chrome, Firefox or Safari (do not recommend Internet Explorer) Activated your MasteryConnect account?1. Locate your “Welcome to MasteryConnect” email2. Click on the link and follow the steps to set up your profile
Registered for this Workshop?3. www.masteryconnect.com/pdsignin4. Session: School Core PD 5. Professional Development Associate: Dean Wilson
Installed the GradeCam Plugin on your computer?
For Windows Users:Download the GradeCam Driver from downloads.gradecam.comDo not run the installer from the browser window. Find the downloaded driver in your downloads list or right-click on the file and select Show in Folder to view the download location.Close all browser windows you have open.Double click on the driver, or right-click and select Run.Once the driver has been installed, restart your computer.
For Mac Users:Download GradeCam Driver from downloads.gradecam.comDouble click to open and run the file.Once the driver has been installed, restart your browser.Note: You may also want to restart your computer, though this is optional
Written your name on the post-it note and placed so your Instructor can see it?
3
Agenda, Ground Rules and Objectives
Agendao MasteryConnect – What?
Why?o The Big Three
o Standardso Trackerso Assessments
o Reportso Curriculum Mapso Account Development Timeo Feedback
Ground Ruleso Stay with me
o Participate
o Ask questions
o Honor Hands off / Heads up
o Silence your technology
o It’s OK to make mistakes
How will this day progress? What does the Instructor need from me? What will I know at the end of the day?
Course ObjectivesAt the conclusion of this session, you will be able to:o Utilize MasteryConnect to identify opportunities for
intervention
o Create curriculum maps and trackers
o Add and administer assessments through multiple means
o Utilize the data in MasteryConnect to inform instruction
4
What is MasteryConnect and Why?
What MasteryConnect does and doesn’t do:Helps To:
o Provides a snapshot of student learningo Identify students’ level of understandingo Target students for intervention, remediation and
enrichmento Reflect on my personal teaching practices
Does Not:o Tell the teacher how to teacho Remediate the student
What do you know about MasteryConnect?1. I know nothing just happy to be here2. I have been introduced and my account is set up3. I have been using MasteryConnect4. I could teach MasteryConnect
What and why?
Why MasteryConnect?
o _______________________________________________________o _______________________________________________________o _______________________________________________________o _______________________________________________________o _______________________________________________________
5
Patchwork Quilt
Knowing what to do with what you see
1. How is this tracker organized?
2. How are the students doing overall?
3. How is this teacher doing overall?
4. If you were this teacher, how would you respond?
Work with a buddy to answer the following questions:
6
Patchwork Quilt, cont.
Knowing what to do with what you see, cont..
1. What looks different from the other Tracker?
2. If you were this teacher, what might you have done for your tracker to look like this?
3. What are the existing concerns?
4. What would be next steps to address existing concerns?
5. How will you benefit from having something like this?
Work with a buddy to answer the following questions:
7
Navigating MasteryConnect
Understanding the general layout and helpful resources
13 2
1 2 3
Activity: Getting Started Find some
Need Help?1. Refer to the Interactive Tutorial.2. Contact your district MasteryConnect support person.3. Visit the MasteryConnect Help Center – Videos, Step Cards, and FAQs.4. Submit a Support Request – [email protected]
Complete your Profile:o Make sure your profile is correct
Make Connections:o Find 5 people and add them to your Community
Assessments:o Bookmark at least 5 assessments
1
8
Assessments
Types and Ways to Add
MINS
Adding Assessments
o Find assessments within the community
o From your existing MasteryConnect assessment library
o Add personal assessments from:
• Your computer
• Google docs
• Dropbox
o Create an Assessment from an Item Bank
Quick Assessments
o Offline Assessment
o Performance Grader
o Socrative
Traditional Assessments
o Paper Based (No Upload)
o Digital
o Item Bank
o Benchmark
9
The Big Three
All about Trackers and what you can do with them
MINS
From Mastery Tracker1. Add Tracker2. Subject: Select3. Core: Select4. Grade Level: Select5. Description: Name of Tracker6. Choose a Folder Color7. Add Students:
a. Type Inb. CSV importc. SIS Integration
Create Tracker
Add Assessment Add / Create / Find
View Standards View all standards in tracker
Add StandardDuplicates / Other Grades / Subjects
Assessment Privacy What parents can and cannot see
Custom Settings Options related to remote scores.
Email All Parents Send mass access email to parents
Print Student Reports Print tracker data on paper
Export to Excel Put tracker data into Excel
Create Curriculum Map Use tracker as a template
Add Collaborators Give others access to your tracker
Assess Assess this standard.
View Standard See detailed definition
Notes Add specific notes about that standard
Resource Pins Add standard aligned support materials
PowerIdentify as a standard that must be taught or will be assessed
Calendar Currently in development.
Sub-StandardCreate discreet objectives to assess within a standard
TRACKER OPTIONS
STANDARD OPTIONS
① Create a Tracker② Identify a Standard to Teach and Assess③ Find or Add an Assessment
HOW TO CREATE A TRACKER
Notes:________________________________________________________________________________________________________________________________________________________________________
10
The Big Three
Activity: Getting Started with The Big Three
MINS
From Mastery Tracker1. Add Tracker2. Subject: Math3. Core: CCSS4. Grade Level: 6th
5. Description: Delete Me (Last Name)
6. Choose a Folder Color7. Add Students:
a. Individually (or)b. Type In
Create Tracker
Create a Fake Tracker
Add 3 Pretend Students1. ______________ ID: 001 2. ______________ ID: 0023. ______________ ID: 003
Complete the Following1. Add a Math, CCSS, 4th Standard
2. Move 6.NS.A.1 to the right of 6.RP.A.2
3. Create sub-standards for 6.RP.A.3
4. Add a collaborator
5. Mark 6.RP.A.1 as a Power Standard
① Create a Tracker② Identify a Standard to Teach and Assess③ Find or Add an Assessment
To-Do’s in the Tracker
o From your “Delete Me” Trackero Lay mouse over 6.RP.A.1 – click on “Assess”o Click – Find a Common Assessmento Filter for:
• Alignment – Single Standard• Question Type – Multiple Choice• MOST VIEWED• Title - Ratios and Proportions (Author: Wesley Poe)
o Add to Tracker What is wrong with this Assessment and how can you fix it?
Let’s talk about the 80/50 Rule!
Identify a Standard to Teach and Assess and Find an Assessment
11
Assessments
What you can do with an Assessment
MINS
Answer Key View/Print answer key.
Reports View reports by assessment.
Print Bubble Sheet Print paper bubblesheets.
Print Student Scores Print assessment scores.
Performance Grader Launches Teacher Page to score assessments
Scan Scores Activate GradeCam to score bubblesheets
Export Scores Copies assessment results to gradebook
Export to Excel Export scores to Excel.
Notes/DateEnter date assessment was administered and notes specific to the assessment
Privacy Privacy settings for reporting
Delete Assessment Delete assessment if needed.
ASSESSMENT OPTIONS
12
Assessments
How To: Adding an assessment to MasteryConnect
For each question in an assessment you must know: 1. Which standard is each question aligned to?2. What is the correct answer?3. What type of questions am I using?4. How many points is each question worth?
1. Open your Tracker - Orange Hamburger2. Click “Add Assessment” 3. Select: (drop-down)
Subject CoreClass Standard(s)
4. Fill in the Blank5. Title 6. Description7. Upload File: (drop-down)
a. Option A. Upload A File From My Computeri. Assessment Fileii. Privacy
b. Option B. No File To Upload (Private To Me)8. Question Type (drop-down)9. Number Of Questions10. Question type: (drop-down)11. Enter per Question: standard, question type, answer, and point value12. Mastery Score
a. Total Points Possibleb. Mastery Scorec. Near Mastery Score
13. Click “Create Assessment”
What should be the Privacy Setting?When do you:
• Keep Private to Self
• Keep Private to School
• Keep Private to District
• Share with the Community
13
Assessments
Activity: Adding an assessment to your Tracker
Before you begin – be sure to know:1. Which standard is each question aligned to?2. What is the correct answer?3. What type of questions am I using?4. How many points is each question worth?
6.RP.A.1 Quiz 1. What is the ratio of wings to beaks for a bird?
A. 1:2B. 3:4C. 2:1
2. What is the ratio of wheels to seats on a tricycle?
D. 1:4E. 3:1F. 5:1
3. What is the ratio of crayons to boxes for a 24-count crayon box?
G. 3:8H. 24:1I. 1:2
4. What is the ratio of headlights to wheels on a car?
J. 2:4K. 6:3L. 2:1
5. What is the ratio of angles on a triangle to angles on a square?
M. 4:3N. 8:3O. 3:4
What should be the Privacy Setting?Answer Key: 1) C 2) B 3) B 4) A 5) C
What will be your Cut Scores?(Add to your Tracker)
14
Offline Assessments
Performance Grader
Hand Entry (Old School & Editing)
Student – MasteryConnect.com/bubblesheet
GradeCam – Student BubbleSheet (paper)
MasteryConnect APPS:
MasteryScan (Teacher – iPad only)
BubbleSheet (Student)
Administering Assessments
All the ways to Administer Assessments
15
Administering Assessments
How To: Offline Assessment & Performance Grader
From the Standard within the tracker you wish to assess
1. Click – Add Assessment2. Click – Use an Assessment Offline3. Enter the Title
a. Total Scoreb. Mastery Scorec. Near Mastery Score
4. Add
To Enter Data:5. Click into the appropriate student’s box6. Type in the final points correct
*It is encouraged to add notes about this assessment – what was the assessment and why.
OFFLINE ASSESSMENTS
From assessment within the tracker for which you want to use the Performance Grader
1. Hover over the title of the assessment and select Performance Grader
2. This will launch the Performance Grader Teacher Page within another tab on your browser
3. In the Performance Grader, you will see your student roster on the left, the assessment in the center, and the response template on the right.
4. Click the student you wish to score and the response template will be available for entry on the right.
5. Data will immediately report back to your Tracker.
PERFORMANCE GRADER
16
Administering Assessments
Activity: Performance Grader
Click on 6.RP.A.1
Click on “Assess” from the drop-down menu
OR
From within the standard –Click
------------------------------------------------------
1. Click - “Add Assessment”
2. Click - “FIND a Common Assessment”
3. In the green filter box – click “+”
1. Alignment – Single Standard
2. Question Type – Rubric Criteria
3. Click - “Peer Reviewed”
4. Find the assessment:
Mathematical Performance
Rubric Created by: Jody Sailor
5. Click - “+ Add to Tracker”
6. Select your tracker
Delete Me
7. Click - “+ Add To Selected”
8. From the Assessment Dropdown
a. Click “Performance Grader”
b. This will launch another browser
tab
From the Performance Grader Page:
9. Select the student to score on the left
10. Assessment appears in the center for
reference
11. Scoring panel is on the right
12. Click the letter per question according to
the students performance.
13. Randomly enter responses – Submit
14. Repeat for next 2 students
15. View Reports: Click - “Reports” from
the drop-down menu
---------------------------------------------------------
FYI: Rubric Criteria4) Expert3) Practitioner2) Apprentice1) Novice
17
Administering Assessments
How To & Activity: Hand Entering Assessment Results (Old School)
MINS
Click on 6.RP.A.1 ORClick on “Assess” from the drop-down menu Click on ------------------------------------------------------------------------------------------------------------------------1. Click “Add Assessment” 2. Click “FIND a Common Assessment” 3. In the green filter box – click on “advanced”
a. Alignment – Single Standardb. Question Type – Multiple Choicec. Click “Peer Reviewed”
4. Find the assessment: Quick Check on Ratios Created by: John Zilla
5. Click “+ Add to Tracker” 6. Select your tracker - Delete Me7. Click “+ Add To Selected” 8. Type in scores for your students:
a. Click on the pencil to add answersb. Remember – Dropdown – Tab – Type, Type, Type
View Reports: Click “Reports” from the drop-down menu FYI: Test Answer Key: 1) B 2) D 3) C 4) B 5) D
1. To Hand Enter assessment Results in your Tracker2. Click into the Tracker3. Click on the standard or assessment (if multi-standard) to score4. If clicking into the standard5. Choose the assessment the scores are for
a. Click into the appropriate student’s box6. For overall results
a. Type in the final points correct7. For item analysis
a. Type in scores for your studentsb. Click on the pencil to add answersc. Remember – Dropdown – Tab – Type, Type, Type
View Reports: Click “Reports” from the drop-down menu
ACTIVITY
HOW TO
18
Administering Assessments
Activity: MasteryConnect.com /bubblesheet
Click on 6.RP.A.1
Click on “Assess” from the drop-down menu
OR
From within the standard –Click
------------------------------------------------------
1. Click - “Add Assessment”
2. Click - “FIND a Common Assessment”
3. In the green filter box – click “+”
1. Alignment – Single Standard
2. Question Type – Multiple Choice
3. Click - “Peer Reviewed”
4. Find the assessment:
6.rp.1 – short quiz
Created by: Mr. James Seaman
5. Click - “+ Add to Tracker”
6. Select your tracker
7. Delete Me
8. Click - “+ Add To Selected”
9. Click
10. (EXAMPLE)
11. Copy the test id number
Open a 2nd tab on your Internet browser
12. Type:
www.masteryconnect.com/bubblesheet
13. In the box (see pic.) paste the id number:
14. Type in student ID # - 001
15. The test will appear – the bubblesheet will
be on the right.
16. Randomly enter responses – Submit
17. Repeat for next 2 students
18. View Reports: Click - “Reports” from the
assessment’s drop-down menu
--------------------------------------------------------------
FYI: Test Answer Key 1) B 2) A 3) D 4) D 5) A
19
Administering Assessments
Activity: GradeCam
FIRST:
1. Click Tracker “Delete Me”
2. Click Standard – 6.RP.A.1
3. Locate the assessment –
a. Ratios and Proportions
b. By: Wesley Poe (was added when creating your Fake Tracker)
NEXT:
4. Locate the blank bubblesheets at the back of this workbook
5. Take the assessment for your students
a. Bubble in student ID
b. Bubble in answer responses
LAST:
6. From the assessment dropdown – Click – Scan Scores
7. Teacher View
a. Place Bubblesheet up to webcam to score
8. Student View
a. Click – student view on the camera
9. Student places bubblesheet up to webcam or document cameral
FYI: Test Answer Key 1) C 2) B 3) A 4) D 5) A 6) C 7) C 8) D 9) D 10) D
20
Administering Assessments
Activity: Assessing with the MasteryScan App
Click on 6.RP.A.1Click on “Assess” from the drop-down menu ORClick on ---------------------------------------------------
1. Click “Add Assessment”
2. Click - FIND a Common Assessment”
3. In the green filter box – click on “+”
a. Alignment – Single Standard
b. Question Type – Multiple Choice
4. Click - “Peer Reviewed”
5. Find the assessment:
Game 11: Understanding Ratios
Created by: Mr. Alex Ott
6. Click - “+ Add to Tracker”
7. Select your tracker
8. Delete Me
9. Click - “+ Add To Selected”
10. Click on the box with the test id:
(example) (This will enlarge the view)
NEXT:
11. Locate the printed copies of this
assessment at the back of this workbook
a. Game 11 - Understanding Ratios
12. Take the assessment for your students
a. Bubble in answer responses On your iPad:
13. Locate the Orange MasteryScanner app
on your iPad
14. Log in using your MasteryConnect
User ID and Password
15. Enter the Test ID#
16. Hover over the bubblesheet to scan
17. Watch your computer as the results
appear!
-------------------------------------------------------- FYI: Test Answer Key 1) B 2) A 3) D 4) D 5) A
21
Assessment Results
Reports: Looking at the Data
MINS
Teacher Reports1. From the homepage click on the “Mastery Tracker” tab2. Find the tracker you want to use and click on it3. Find the standard you want to use and click on it4. Find the test you want to use and hover over it5. Click on the “Reports” button6. You can view the following by clicking on their individual tabs
Item Analysis1. Dropdown to view other options
a. My trackers, b. teachers in my schoolc. Teams
2. Click on each bar to view which students chose which items
Student Mastery3. Dropdown to view other options
a. My trackers b. Teachers in my schoolc. Teams
Tracker Comparison 4. Compare Individual class to class 5. When giving all classes the same 6. assessment
Teacher Comparison7. Dropdown to view other options
a. Teachers in my schoolb. Teams
22
Account Development Time
Strong recommendations and other suggestions.
YOUR TIME
MINS Complete all of the REQUIRED tasks above
With any remaining time, explore the other suggested tasks.
Required Tasks
Suggested Tasks
Delete training tracker Create tracker(s) Identify assessments you want to add Determine assessing modes best for you – practice Work with your team to discuss implementation
Invite more teachers Bookmark more assessments (if applicable) Follow more teachers Upload assessments Download MasteryConnect apps Play around with Resource Pins Explore help topics Locate assessments in the community
23
Resource: Curriculum Maps
1. Create a Team (Important: The “Owner” is the “Team”)
From the home screen click “Learning Community”Click “Teams” Click “Add Team”Complete the fieldsTo select the members – type their name in the box and select as they appear in the list.“Create”
2. Create a Curriculum MapFrom the home screen click “Mastery Tracker”Click “Curriculum Maps”Click “+ Add Curriculum Map”Choose the owner (drop-down)Fill in the Blanks
Map NameDescriptionPrivacy (drop-down)Select: (drop-down)SubjectCoreClassClick “Create Curriculum Map 3. Create Units within a Curriculum MapFrom the “hamburger” click “add a unit”Fill in “Unit Name”Add Description (optional)Choose ColorClick “Add Unit”Drag and drop standards into the unit.
4. Add Sub StandardChoose StandardExpand Standard DescriptionCopy descriptionHover over standard-level hamburgerClick “Add Substandard”Paste description into the description boxName SubstandardCut and Paste desired information into appropriate fieldsClick “Create”
5. Add Assessments (CM or Standard)From hamburger click “Add Assessment” Choose From:
Find a Common Assessment Select from My LibraryCreate a New AssessmentOnce you have selected/uploaded your assessment click “+ Add To Curriculum Map”Select the map that you want to add the assessment – click “+ Add To Selected” View/Customize StandardView the Standard and ability to Customize / re-word the standard.Resource PinsPin web resources and support documents to the standard 6. Create a Tracker from a Curriculum MapSelect “+ Create Tracker From Map” button OR hover over the hamburger and click “Create Tracker From Map”DescriptionFolder ColorAdd Students (dropdown)Click “Create Tracker”
To update your tracker from the Curriculum Map:
1. In the gray box on the right “Apply Update to to my Trackers:
2. Choose the tracker(s) you want to update3. Click “Apply Updates”
24
Resource: Exporting Data to Gradebook
NOTE: Before you export your grades make sure your gradebook and your student list on MasteryConnect are ordered the same way. 1. From the home screen click on the “Mastery Tracker” tab 2. Find the tracker you want to use and click on it 3. Find the standard you want to use and click on it 4. Find the test you want to export and hover over it 5. Click on the “Export Scores” button 6. Choose to export either: a. Scores b. Mastery c. Percent 7. Keep the window (page) open and switch to your gradebook window (page) 8. Put your cursor in the first scoring input field and press the F8 key
on your keyboard (On a Mac press fn and F8)
25
Bubblesheets
Activity: GradeCam Bubblesheets
26
Administering Assessments
MasteryScan – Practice Assessment (Student 001)
Game 11: Writing Ratios (Alex Ott)
1) Glentrian has 7 pairs of red socks and 12 pairs of blue socks. Which ratio represents how many red socks Glentrian has compared to blue socks?
A) 7:12 B) 12:7 C) 7:19 D) 12:19
2) Ivory ordered ice cream with 5 scoops of chocolate and 2 scoops of vanilla. Which ratio represents the number of vanilla scoops to chocolate scoops?
A) 5 to 2 B) 2 to 5 C) 7 to 5 D) 7 to 2
3) Marcel ate 6 carrots and 5 apples. What is the ratio of apples to carrots that Marcel ate?
A) 5:6 B) 5:11 C) 11:5 D) 11:6
4) Mr. Ott owns 7 soccer balls and 4 football helmets. What is the ratio of soccer balls to all sports equipment that he owns?
A) 7:4 B) 7:11 C) 11:7 D) 4:11
5) Which model represents a ratio of 8 shaded blocks totwelve total blocks?
27
Administering Assessments
MasteryScan – Practice Assessment (Student 002)
Game 11: Writing Ratios (Alex Ott)
1) Glentrian has 7 pairs of red socks and 12 pairs of blue socks. Which ratio represents how many red socks Glentrian has compared to blue socks?
A) 7:12 B) 12:7 C) 7:19 D) 12:19
2) Ivory ordered ice cream with 5 scoops of chocolate and 2 scoops of vanilla. Which ratio represents the number of vanilla scoops to chocolate scoops?
A) 5 to 2 B) 2 to 5 C) 7 to 5 D) 7 to 2
3) Marcel ate 6 carrots and 5 apples. What is the ratio of apples to carrots that Marcel ate?
A) 5:6 B) 5:11 C) 11:5 D) 11:6
4) Mr. Ott owns 7 soccer balls and 4 football helmets. What is the ratio of soccer balls to all sports equipment that he owns?
A) 7:4 B) 7:11 C) 11:7 D) 4:11
5) Which model represents a ratio of 8 shaded blocks totwelve total blocks?
28
Administering Assessments
MasteryScan – Practice Assessment (Student 003)
Game 11: Writing Ratios (Alex Ott)
1) Glentrian has 7 pairs of red socks and 12 pairs of blue socks. Which ratio represents how many red socks Glentrian has compared to blue socks?
A) 7:12 B) 12:7 C) 7:19 D) 12:19
2) Ivory ordered ice cream with 5 scoops of chocolate and 2 scoops of vanilla. Which ratio represents the number of vanilla scoops to chocolate scoops?
A) 5 to 2 B) 2 to 5 C) 7 to 5 D) 7 to 2
3) Marcel ate 6 carrots and 5 apples. What is the ratio of apples to carrots that Marcel ate?
A) 5:6 B) 5:11 C) 11:5 D) 11:6
4) Mr. Ott owns 7 soccer balls and 4 football helmets. What is the ratio of soccer balls to all sports equipment that he owns?
A) 7:4 B) 7:11 C) 11:7 D) 4:11
5) Which model represents a ratio of 8 shaded blocks totwelve total blocks?
29
Resource: Resource Pins
How to find Resource Pins1. From the home screen click on the “Resource Pins” tab2. Choose: (dropdown menu) Subject Core Class Standard3. Hover over the Pin you want and click on the “Repin” button that appears4. Choose the “Resource Board” from the dropdown menu that you want to pin it to.5. Fill in the “Description” box about the pin 6. Click on the “+ Pin It” button Editing Pins1. From the home screen click on the “Resource Pins” tab2. Click on the “My Pins” tab3. Choose: (dropdown menu) Subject Core Class Standard4. After finding the pin you want to edit click on the pencil located in the pin5. Choose: (dropdown menu) Resource Board 6. Add a Standard: (dropdown menu) Subject Core Class Standard7. To add more standards click on the “+ Add Another” button and repeat step 68. View or delete standards underneath “Standards Used” 9. Edit the Description (fill in the blank)10. Click on the “Update Pin” button to update your pin
Deleting a Pin1. From the home screen click on the “Resource
Pins” tab2. Click on the “My Pins” tab3. Choose: (dropdown menu) Subject Core Class Standard4. After finding the pin you want to delete click on the pencil located in the pin5. Click on the “Delete This Pin” button
My likes1. From the home screen click on the “Resource Pins” tab2. Choose: (dropdown menu) Subject Core Class Standard3. Hover over the Pin you want and click on the “Like” button that appears4. View your “Likes” by clicking on “My Likes” tab Adding Resource Pins1. From the home screen click “Resource Pins”2. Click on “+Add Resource Pin” button3. Upload the file from your computer by clicking on the “Browse…” button 4. Select the file you want to use click on the “Open” 5. Copy a web address to find an image (fill in the blank) 6. Click “Find Images” 7. Choose: (dropdown menu)
Resource Board Subject Core Class Standard8. Describe the pin (fill in the blank)9. Click on the “Pin It” button
30
Resource: Item Banks
1. Open your Tracker - Orange Hamburger2. Click “Add Assessment” 3. Select: (drop-down)
Subject CoreClass Standard(s)
4. Fill in the Blank5. Title 6. Description7. Assessment Type: NWEA Formative Assessment Item Bank8. Shuffle - # of Questions (random selection)9. Item Type10. DOK Level11. GradeCam (Item must have this icon if you want to be able to print) 12. Passages (Match passage name / number – will print aligned items to each passage)13. Mastery Score
a. Total Points Possibleb. Mastery Scorec. Near Mastery Score
14. Click “Create Assessment”
Notes:________________________________________________________________________________________________________________________________________________________________________