NCOTeam.orgNCOTeam.orgCollaboration in Networks, Communities Collaboration in Networks, Communities
and Forumsand Forums
September 2004September 2004
September 2004 NCOTeam.org 2
Sample SizeSample Size
• 42 Users responded to Questionnaire 142 Users responded to Questionnaire 1
• 9 Knowledge Managers responded to 9 Knowledge Managers responded to Questionnaire 2Questionnaire 2
September 2004 NCOTeam.org 3
• NCOTeam users are MilitaryNCOTeam users are Military
• Most are SFC, SSG, SGTMost are SFC, SSG, SGT
• Most have been with the Army for more Most have been with the Army for more than 5, but less than 25 yearsthan 5, but less than 25 years
• Nearly all are between 21 and 50 years old Nearly all are between 21 and 50 years old with nearly 60% between 31-40 years oldwith nearly 60% between 31-40 years old
Profile of UsersProfile of Users
September 2004 NCOTeam.org 4
NCOTeam: NCOTeam: Comfort/Skill Level In Using TechnologyComfort/Skill Level In Using Technology
• Respondents technologically sophisticated, Respondents technologically sophisticated, compared with other userscompared with other users
• When asked to identify comfort/skill in When asked to identify comfort/skill in using technology, 35 of the 36 users (97%) using technology, 35 of the 36 users (97%) selected levels 3 or 4selected levels 3 or 4
– Level 3: Comfortable using most tools & Level 3: Comfortable using most tools & features/ can solve most problemsfeatures/ can solve most problems
– Level 4: Comfortable using full range of tools & Level 4: Comfortable using full range of tools & features/likes to experimentfeatures/likes to experiment
September 2004 NCOTeam.org 5
How Long Have Respondents Been How Long Have Respondents Been Users Of NCOTeam?Users Of NCOTeam?
• 8 (19%) for less than 6 months8 (19%) for less than 6 months
• 11 (26.2%) for 7-12 months11 (26.2%) for 7-12 months
• 10 (23.8%) for 1-2 years10 (23.8%) for 1-2 years
• 10 (23.8%) for 2-5 years10 (23.8%) for 2-5 years
• 3 (7.1%) for more than 5 years3 (7.1%) for more than 5 years
September 2004 NCOTeam.org 6
How Many NCOTeam Users Have Held How Many NCOTeam Users Have Held Leadership Roles In The NCF?Leadership Roles In The NCF?
• 20 (47.6%) respondents have held 20 (47.6%) respondents have held leadership rolesleadership roles
• More NCOTeam respondents have More NCOTeam respondents have notnot held held leadership roles when compared with users leadership roles when compared with users of other NCFsof other NCFs
September 2004 NCOTeam.org 7
What Technologies Were UsedWhat Technologies Were Used to Access NCOTeam.org? to Access NCOTeam.org?
• Most users accessed through: Most users accessed through:
– DesktopDesktop
– Portable computerPortable computer
• Some accessed through web-accessed Some accessed through web-accessed toolstools
September 2004 NCOTeam.org 8
How Satisfied Are NCOTeam Users?How Satisfied Are NCOTeam Users?
• NCOTeam users are more satisfied than NCOTeam users are more satisfied than other usersother users
• Mean satisfaction level for the 40 NCOTeam Mean satisfaction level for the 40 NCOTeam respondents was 4.37 (SD=1.44) on a scale respondents was 4.37 (SD=1.44) on a scale of 1=very satisfied to 5= very satisfied of 1=very satisfied to 5= very satisfied
• The mean satisfaction for other users was The mean satisfaction for other users was 3.81 (SD=1.34)3.81 (SD=1.34)
September 2004 NCOTeam.org 9
Objectives in the QuestionnaireObjectives in the Questionnaire
• Find information Find information
• Get rich and timely Get rich and timely feedback from expertsfeedback from experts
• Get quick clarificationGet quick clarification
• Get lessons learnedGet lessons learned
• Get TTPsGet TTPs
• Work on tasks with othersWork on tasks with others
• Engage in conversationEngage in conversation
• Share information and Share information and storiesstories
• Connect with othersConnect with others
• Build relationshipsBuild relationships
• Strengthen networksStrengthen networks
• Feel part of a communityFeel part of a community
• Prepare for a new jobPrepare for a new job
• Solve a problemSolve a problem
• Stay current on relevant Stay current on relevant news and eventsnews and events
September 2004 NCOTeam.org 10
NCOTeam: Importance Of ObjectivesNCOTeam: Importance Of Objectives
First joinedFirst joined NowNow
Find informationFind information XX XX
Get quick clarificationGet quick clarification XX XX
Get rich & timely feedback from expertsGet rich & timely feedback from experts XX XX
Solve a problemSolve a problem XX XX
Stay current on relevant news/eventsStay current on relevant news/events XX XX
Get lessons learntGet lessons learnt XX XX
Get TTPsGet TTPs XX XX
Share information and storiesShare information and stories XX XX
September 2004 NCOTeam.org 11
• The most important and least important The most important and least important objectives have not changedobjectives have not changed
• Some objectives have become significantly Some objectives have become significantly more importantmore important
NCOTeam Objectives: Changes in ImportanceNCOTeam Objectives: Changes in Importance
- Get lessons learned- Get lessons learned- Get TTPS- Get TTPS- Solve a problem- Solve a problem- Find information- Find information- Get rich and timely feedback from experts- Get rich and timely feedback from experts- Stay current on relevant news and events- Stay current on relevant news and events
September 2004 NCOTeam.org 12
NCOTeam: NCOTeam: Which Objectives Are Being Met Now?Which Objectives Are Being Met Now?
- Find informationFind information- Get rich and timely feedback from expertsGet rich and timely feedback from experts- Get quick clarificationGet quick clarification- Share information and storiesShare information and stories- Solve a problemSolve a problem- Stay current on relevant news & eventsStay current on relevant news & events- Get lessons learnedGet lessons learned
• Most objectives are being met well nowMost objectives are being met well now
September 2004 NCOTeam.org 13
Other Users: Importance Of Objectives Other Users: Importance Of Objectives
First joinedFirst joined NowNow
Find informationFind information XX XX
Get lessons learnedGet lessons learned XX XX
Solve a problemSolve a problem XX XX
Get quick clarificationGet quick clarification XX XX
Share information and storiesShare information and stories XX XX
Stay current on relevant news/eventsStay current on relevant news/events XX XX
Somewhat importantSomewhat important
Most importantMost important
September 2004 NCOTeam.org 14
Other Users’ ObjectivesOther Users’ Objectives
• Other users report most objectives are Other users report most objectives are being met less well nowbeing met less well now
• Other users’ objectives are not Other users’ objectives are not significantly different now than when they significantly different now than when they first joined their NCFfirst joined their NCF
September 2004 NCOTeam.org 15
Objectives: NCOTeam Users Compared Objectives: NCOTeam Users Compared With Other UsersWith Other Users
• AllAll objectives are objectives are more importantmore important now for now for NCOTeam compared with other usersNCOTeam compared with other users
• AllAll objectives are being objectives are being better metbetter met for for NCOTeam users than for other usersNCOTeam users than for other users
September 2004 NCOTeam.org 16
Capabilities that Knowledge Managers Capabilities that Knowledge Managers say are provided by NCOTeam.orgsay are provided by NCOTeam.org
• Repository of up-to-date documentsRepository of up-to-date documents
• Knowledge objects that are updatedKnowledge objects that are updated
• Ability to version and maintain history of an issueAbility to version and maintain history of an issue
• SearchabilitySearchability
• Ability to notifyAbility to notify
• Two-way interactionTwo-way interaction
• Group interactionGroup interaction
• Polling/surveyPolling/survey
• Decision-making scenariosDecision-making scenarios
• Ability to create sub-communitiesAbility to create sub-communities
• Ability to subscribe to information servicesAbility to subscribe to information services
September 2004 NCOTeam.org 17
NCOTeam: Capabilities That Are Most NCOTeam: Capabilities That Are Most Important and ProvidedImportant and Provided
• Repository of up-to-date documents Repository of up-to-date documents
• Knowledge objects that are updatedKnowledge objects that are updated
• SearchabilitySearchability
• Ability to notifyAbility to notify
• Ability to version and maintain history of an issueAbility to version and maintain history of an issue
• Group interactionGroup interaction
• Decision-making scenariosDecision-making scenarios
• Two-way interactionTwo-way interaction
• Customized information and dataCustomized information and data
September 2004 NCOTeam.org 18
NCOTeam: Capabilities That Are Less NCOTeam: Capabilities That Are Less ImportantImportant
• Other capabilities were reported as least Other capabilities were reported as least important…but means for importance of important…but means for importance of capabilities range from 3.25-3.97 on a capabilities range from 3.25-3.97 on a scale of 1 to 5, 1=not at all important, scale of 1 to 5, 1=not at all important, 5=extremely important5=extremely important
• The importance of these capabilities is The importance of these capabilities is rated positively by NCOTeam usersrated positively by NCOTeam users
September 2004 NCOTeam.org 19
NCOTeam: Frequency of Use of NCOTeam: Frequency of Use of Capabilities (Daily/Weekly)Capabilities (Daily/Weekly)
By 65% or MoreBy 65% or More By 50% to 64%By 50% to 64%
Knowledge objects that are Knowledge objects that are updatedupdated
Two-way interactionTwo-way interaction
Group interactionGroup interaction Customized information or Customized information or datadata
Decision-making scenariosDecision-making scenarios Polling/ScalePolling/Scale
Repository of up-to-date Repository of up-to-date documentsdocuments
Ability to rank and evaluateAbility to rank and evaluate
SearchabilitySearchability
September 2004 NCOTeam.org 20
Other Users: Frequency of Use of Other Users: Frequency of Use of Capabilities (Daily/Weekly)Capabilities (Daily/Weekly)
By 50% or MoreBy 50% or More By 30% to 50%By 30% to 50%
SearchabilitySearchability Knowledge objects that are Knowledge objects that are updatedupdated
Repository of up-to-date Repository of up-to-date documentsdocuments
Ability to notifyAbility to notify
Ability to version and Ability to version and maintain history of an issuemaintain history of an issue
September 2004 NCOTeam.org 21
Capabilities: NCOTeam Users Capabilities: NCOTeam Users Compared With Other UsersCompared With Other Users
• While several capabilities are While several capabilities are more more importantimportant for NCOTeam users than for for NCOTeam users than for other users, most of the capabilities are other users, most of the capabilities are rated rated as importantas important by other users as they by other users as they are by NCOTeam usersare by NCOTeam users
• Many capabilities are used Many capabilities are used more oftenmore often by by NCOTeam users than by other usersNCOTeam users than by other users
September 2004 NCOTeam.org 22
Features/Tools that Knowledge Features/Tools that Knowledge Managers say are provided by Managers say are provided by
NCOTeam.orgNCOTeam.org• Presence and awareness Presence and awareness
of who else is onlineof who else is online
• Knowledge repository Knowledge repository accessaccess
• Search enginesSearch engines
• Electronic voting/vettingElectronic voting/vetting
• Member locatorMember locator
• ChatChat
• Instant messagingInstant messaging
• Discussion forumsDiscussion forums
• Public/private spacesPublic/private spaces
• Subscriptions services to Subscriptions services to have information pushed have information pushed to youto you
• Personalized information Personalized information displaydisplay
September 2004 NCOTeam.org 23
NCOTeam: NCOTeam: ImportanceImportance of Features/Tools of Features/Tools• Which features/tools are important?Which features/tools are important?
– Discussion forums (Mean=4.50)Discussion forums (Mean=4.50)
– Knowledge Repository (Mean=3.92)Knowledge Repository (Mean=3.92)
– Expertise locator (Mean=3.89)Expertise locator (Mean=3.89)
• Which features/tools are least important? (Means range Which features/tools are least important? (Means range from 1.41-1.70)from 1.41-1.70)
– Video teleconferencingVideo teleconferencing
– AudioAudio
– WebcastingWebcasting
– Taxonomy CreationTaxonomy Creation
– WhiteboardingWhiteboarding
– CalendarCalendar
September 2004 NCOTeam.org 24
Other Users: Other Users: ImportanceImportance of Features/Tools of Features/Tools
• Which features/tools are most important?Which features/tools are most important?– Search engines (Mean=3.90)Search engines (Mean=3.90)
– Knowledge repository access (Mean=3.80)Knowledge repository access (Mean=3.80)
– Expertise locator (Mean=3.15)Expertise locator (Mean=3.15)
– Member locator (Mean=3.05)Member locator (Mean=3.05)
• Which features/tools are least important? (Means Which features/tools are least important? (Means range from 1.68 to 1.85)range from 1.68 to 1.85)– WhiteboardingWhiteboarding
– Audio (VoIP)Audio (VoIP)
– VideoVideo
September 2004 NCOTeam.org 25
Importance of Features/Tools: NCOTeam Importance of Features/Tools: NCOTeam Users Compared With Other UsersUsers Compared With Other Users
• The following features/tools are more important The following features/tools are more important for NCOTeam users than for other usersfor NCOTeam users than for other users
– Discussion forumsDiscussion forums
– Presence and awarenessPresence and awareness
– Electronic voting/vettingElectronic voting/vetting
– ChatChat
– Instant MessagingInstant Messaging
– Expertise locatorExpertise locator
• Taxonomy creation is less important for Taxonomy creation is less important for NCOTeam users than other usersNCOTeam users than other users
September 2004 NCOTeam.org 26
NCOTeam: NCOTeam: FrequencyFrequency of Use of of Use of Features/Tools (Daily/Weekly)Features/Tools (Daily/Weekly)
By 60% or MoreBy 60% or More By 40% to 60%By 40% to 60%
Discussion forumsDiscussion forums Personalized information Personalized information displaydisplay
Presence and awareness Presence and awareness Public/private spacesPublic/private spaces
Knowledge repository Knowledge repository accessaccess
Expertise locatorExpertise locator
Decision support systemsDecision support systems
Electronic voting/vettingElectronic voting/vetting
September 2004 NCOTeam.org 27
Other Users: Other Users: FrequencyFrequency of Use of Features/Tools of Use of Features/Tools
By 40% or More (Daily or By 40% or More (Daily or Weekly)Weekly)
By 25% or More By 25% or More (Monthly/Occasionally)(Monthly/Occasionally)
Knowledge repository Knowledge repository accessaccess
Search enginesSearch engines
Search enginesSearch engines Knowledge repository Knowledge repository accessaccess
Member locatorMember locator
Expertise locatorExpertise locator
Discussion forumsDiscussion forums
Public/private spacesPublic/private spaces
September 2004 NCOTeam.org 28
Frequency of Use: NCOTeam Users Frequency of Use: NCOTeam Users compared with Other Userscompared with Other Users
• Discussion forumsDiscussion forums
• Presence and awareness of who else is onlinePresence and awareness of who else is online
• Electronic voting/vettingElectronic voting/vetting
• Decision support systemsDecision support systems
• Personalized information display(s)Personalized information display(s)
• Public/private spacesPublic/private spaces
• Expertise locatorExpertise locator
• ChatChat
• Instant MessagingInstant Messaging
• Subscription services to have information pushed to youSubscription services to have information pushed to you
The following features/tools are used The following features/tools are used more oftenmore often by by NCOTeam Users than Other UsersNCOTeam Users than Other Users
September 2004 NCOTeam.org 29
Problems With Features/Tools UsedProblems With Features/Tools Used
Feature/ToolFeature/Tool NCOTeamNCOTeam Other UsersOther UsersPersonalized information displaysPersonalized information displays XX
Presence and awarenessPresence and awareness XX
Knowledge repository accessKnowledge repository access XX XX
Search enginesSearch engines XX XX
Electronic voting/vettingElectronic voting/vetting XX
Member locatorMember locator XX XX
Expertise locatorExpertise locator XX XX
ChatChat XX
Instant MessagingInstant Messaging XX
Discussion ForumsDiscussion Forums XX XX
September 2004 NCOTeam.org 30
Problems With Features/Tools:Problems With Features/Tools:NCOTeam Users Compared With Other Users NCOTeam Users Compared With Other Users
• NCOTeam users reported fewer problems NCOTeam users reported fewer problems than other users with the following than other users with the following features:features:
– Knowledge repository accessKnowledge repository access
– Search enginesSearch engines
– Public/private spacesPublic/private spaces
September 2004 NCOTeam.org 31
Patterns of Use in QuestionnairePatterns of Use in Questionnaire
• DownloadingDownloading
• UploadingUploading
• Locating/contacting peers/expertsLocating/contacting peers/experts
• Seeking responsesSeeking responses
• Engaging in conversationEngaging in conversation
• Working with othersWorking with others
September 2004 NCOTeam.org 32
Downloading: ImportanceDownloading: Importance (It is very important to download…) (It is very important to download…)
For NCOTeam UsersFor NCOTeam Users For Other UsersFor Other Users
Information/dataInformation/data DocumentsDocuments
DocumentsDocuments Information/dataInformation/data
Lessons learned with Lessons learned with contextcontext
Best practicesBest practices
Opinions/judgmentsOpinions/judgments
Experiences/storiesExperiences/stories
September 2004 NCOTeam.org 33
Downloading: Frequency Downloading: Frequency (Daily/Weekly)(Daily/Weekly)
Features/ToolsFeatures/Tools By 50%+ By 50%+ NCOTeam NCOTeam UsersUsers
By 50%+ Other By 50%+ Other UsersUsers
Experiences/storiesExperiences/stories XX
Opinions/judgmentsOpinions/judgments XX
Information/dataInformation/data XX XX
Lessons learned with Lessons learned with contextcontext
XX
Best PracticesBest Practices XX
DocumentsDocuments XX XX
September 2004 NCOTeam.org 34
Importance/Frequency of Downloading: Importance/Frequency of Downloading: Comparison of NCOTeam Users With Other UsersComparison of NCOTeam Users With Other Users
Compared With Other Users, NCOTeam Users:Compared With Other Users, NCOTeam Users:Find it More Important to DownloadFind it More Important to Download Download More Often Download More Often
Lessons learned with contextLessons learned with context Lessons learned with contextLessons learned with context
Best practicesBest practices Best practicesBest practices
Experiences/storiesExperiences/stories Experiences/storiesExperiences/stories
Opinions/judgmentsOpinions/judgments Opinions/judgmentsOpinions/judgments
Information/dataInformation/data Video and audioVideo and audio
DocumentsDocuments
Video and AudioVideo and Audio
September 2004 NCOTeam.org 35
Uploading: ImportanceUploading: Importance (It is most important to upload…) (It is most important to upload…)
For NCOTeam UsersFor NCOTeam Users For Other UsersFor Other Users
Opinions/judgmentsOpinions/judgments DocumentsDocuments
Experiences/storiesExperiences/stories Information/dataInformation/data
September 2004 NCOTeam.org 36
Uploading: Frequency (Daily/Weekly) Uploading: Frequency (Daily/Weekly)
Features/ToolsFeatures/Tools By 50%+ By 50%+ NCOTeam NCOTeam UsersUsers
By 30%+ Other By 30%+ Other UsersUsers
Experiences/storiesExperiences/stories XX
Opinions/judgmentsOpinions/judgments XX
DocumentsDocuments XX
September 2004 NCOTeam.org 37
Importance/Frequency of Uploading: Importance/Frequency of Uploading: Comparison of NCOTeam Users With Comparison of NCOTeam Users With
Other UsersOther Users
Compared With Other Users, NCOTeam Users:Compared With Other Users, NCOTeam Users:
Find it More Important to UploadFind it More Important to Upload Upload More Often Upload More Often
Experiences/storiesExperiences/stories Experiences/storiesExperiences/stories
Opinions/judgmentsOpinions/judgments Opinions/judgmentsOpinions/judgments
Best practicesBest practices Lessons learned with contextLessons learned with context
Lessons learned with contextLessons learned with context Best practicesBest practices
September 2004 NCOTeam.org 38
NCOTeam Users: NCOTeam Users: Locating/Contacting Peers/ExpertsLocating/Contacting Peers/Experts
• It is somewhat important to locate and It is somewhat important to locate and contact peers and expertscontact peers and experts
• 40%+ of NCOTeam do so daily/weekly40%+ of NCOTeam do so daily/weekly
September 2004 NCOTeam.org 39
• It is somewhat important to locate and It is somewhat important to locate and contact peers and experts. contact peers and experts.
• 30% contact peers daily/weekly30% contact peers daily/weekly
• About 20% contact experts daily/weeklyAbout 20% contact experts daily/weekly
Other Users: Other Users: Locating/Contacting Peers/ExpertsLocating/Contacting Peers/Experts
September 2004 NCOTeam.org 40
Locating/Contacting Peers/Experts: Locating/Contacting Peers/Experts: Comparison of NCOTeam Users with Comparison of NCOTeam Users with
Other UsersOther Users• More importantMore important for NCOTeam Users to for NCOTeam Users to
contact experts than for other userscontact experts than for other users
• NCOTeam Users locate/contact experts NCOTeam Users locate/contact experts more oftenmore often than do other users than do other users
September 2004 NCOTeam.org 41
Seeking Responses: ImportanceSeeking Responses: Importance
• It is It is veryvery important for important for NCOTeamNCOTeam Users...and Users...and somewhatsomewhat important for important for OtherOther Users…to seek Users…to seek
– General informationGeneral information
– AdviceAdvice
– HelpHelp
– FeedbackFeedback
– Descriptions of situations or problemsDescriptions of situations or problems
– ClarificationClarification
September 2004 NCOTeam.org 42
Seeking Responses: FrequencySeeking Responses: Frequency
• More than 55% of all NCOTeam users More than 55% of all NCOTeam users report that they seek all of these things report that they seek all of these things daily/weeklydaily/weekly
• 25-30% of Other Users seek these things 25-30% of Other Users seek these things daily/weeklydaily/weekly
September 2004 NCOTeam.org 43
Seeking Responses: NCOTeam Users Seeking Responses: NCOTeam Users Compared With Others Compared With Others
• More important for NCOTeam Users than More important for NCOTeam Users than others to seekothers to seek
– General informationGeneral information
– Description of situations or problemsDescription of situations or problems
– ClarificationClarification
– AdviceAdvice
– HelpHelp
• And they do so more oftenAnd they do so more often
September 2004 NCOTeam.org 44
Engaging In Conversation:Engaging In Conversation: Importance and Frequency Importance and Frequency
Conversations Very Conversations Very Important For NCOTeam Important For NCOTeam
UsersUsers
Conversations Conversations Somewhat Important For Somewhat Important For
Other UsersOther Users
About issue or subjectAbout issue or subject About an issue or About an issue or subjectsubject
About the professionAbout the profession Linked to contentLinked to content
Linked to contentLinked to content
68% of 68% of ALLALL Users do so daily/weekly Users do so daily/weekly
September 2004 NCOTeam.org 45
Engaging in Conversation: NCOTeam Engaging in Conversation: NCOTeam Users Compared With Other UsersUsers Compared With Other Users
• More important for NCOTeam Users than More important for NCOTeam Users than others to engage in conversationsothers to engage in conversations
– About an issue or subjectAbout an issue or subject
– About the professionAbout the profession
– Linked to contentLinked to content
– ChatChat
• And they do so more oftenAnd they do so more often
September 2004 NCOTeam.org 46
Working With Others: NCOTeam UsersWorking With Others: NCOTeam Users
• It is important to work with others It is important to work with others
– To debate issues and solve problems (60%+ To debate issues and solve problems (60%+ do so daily/weekly)do so daily/weekly)
– To generate new ideas (40%+ do so To generate new ideas (40%+ do so daily/weekly)daily/weekly)
• It is less important to work with othersIt is less important to work with others
– On a document or a knowledge object (20-31% On a document or a knowledge object (20-31% do so daily/weekly)do so daily/weekly)
September 2004 NCOTeam.org 47
Working With Others: Other UsersWorking With Others: Other Users
• It is somewhat important to work with It is somewhat important to work with others for all purposesothers for all purposes
• 30%+ work with others daily/weekly for all 30%+ work with others daily/weekly for all purposespurposes
September 2004 NCOTeam.org 48
Working With Others: NCOTeam Users Working With Others: NCOTeam Users Compared With Other UsersCompared With Other Users
• NCOTeam Users compared to Other UsersNCOTeam Users compared to Other Users
– Find it more important to work together to Find it more important to work together to debate issues and to generate new ideasdebate issues and to generate new ideas
– Do so more often to debate issues and to solve Do so more often to debate issues and to solve problemsproblems
September 2004 NCOTeam.org 49
Comfort With Participation: Comfort With Participation:
• NCOTeam Users report they are more NCOTeam Users report they are more comfortable…and Other Users report they comfortable…and Other Users report they are less comfortableare less comfortable
– Suggesting ideas even if others disagreeSuggesting ideas even if others disagree
– Contributing new ideasContributing new ideas
– Recommending the use of the NCF to othersRecommending the use of the NCF to others
September 2004 NCOTeam.org 50
Website: NCOTeam UsersWebsite: NCOTeam Users
• Characterize the content of website as Very Characterize the content of website as Very useful, Well managed, Well organized, & Up-to-useful, Well managed, Well organized, & Up-to-date ( Means exceeded 4.8)date ( Means exceeded 4.8)
• View the website as User friendly in look and feel, View the website as User friendly in look and feel, organized in ways that reflect the way work is organized in ways that reflect the way work is done, & easy to (Means exceeded 4.6):done, & easy to (Means exceeded 4.6):
– Use overallUse overall
– ManipulateManipulate
– NavigateNavigate
– UpdateUpdate
September 2004 NCOTeam.org 51
Website: Comparison to Other UsersWebsite: Comparison to Other Users
• NCOTeam Users rated content, NCOTeam Users rated content, organization, ease of use significantly organization, ease of use significantly higher than Other Usershigher than Other Users
• Other Users rated these things somewhat Other Users rated these things somewhat positively (Means from 3.16 to 3.53)positively (Means from 3.16 to 3.53)
September 2004 NCOTeam.org 52
NCOTeam Users: Resources Provided NCOTeam Users: Resources Provided and Users’ Satisfactionand Users’ Satisfaction
ResourcesResources How much How much providedprovided
How satisfiedHow satisfied
Facilitation of Discussions, Facilitation of Discussions, Mentors, Expert Resources, Mentors, Expert Resources, Topic/Page LeadersTopic/Page Leaders
A lot A lot (Means=4.7+)(Means=4.7+)
Very SatisfiedVery Satisfied
Technical support, Technical support, Comprehensive help files, Comprehensive help files, Tutorials/training supportTutorials/training support
Quite a bit Quite a bit (Means (Means
around 4.0)around 4.0)
Quite SatisfiedQuite Satisfied
Information from and Information from and suggestions to school suggestions to school househouse
Some (Means Some (Means from 3.4-3.6)from 3.4-3.6)
Quite SatisfiedQuite Satisfied
September 2004 NCOTeam.org 53
Resources Provided and Users’ Resources Provided and Users’ Satisfaction: Comparison to Other Satisfaction: Comparison to Other
UsersUsers• NCOTeam Users much more satisfied with NCOTeam Users much more satisfied with
all resources provided than are Other all resources provided than are Other UsersUsers
• Other Users provide some resources Other Users provide some resources (Means from 2.61-3.31)(Means from 2.61-3.31)
• Other Users somewhat dissatisfied with Other Users somewhat dissatisfied with these resources (Means from 2.45-3.02)these resources (Means from 2.45-3.02)
September 2004 NCOTeam.org 54
Outcomes: Time SavedOutcomes: Time Saved
• NCOTeam Users report considerable time NCOTeam Users report considerable time savings (Means exceed 4.3) in savings (Means exceed 4.3) in
– Finding resourcesFinding resources
– Finding information or expertiseFinding information or expertise
– Solving problemsSolving problems
– Making decisionsMaking decisions
– Analyzing data or informationAnalyzing data or information
September 2004 NCOTeam.org 55
Time Saved:Time Saved: Comparison With Other Users Comparison With Other Users
• NCOTeam Users saved more time in all NCOTeam Users saved more time in all categories than Other Userscategories than Other Users
• Other Users report participation in NCF Other Users report participation in NCF has not helped them save a lot of time has not helped them save a lot of time (Means from 2.64-3.27)(Means from 2.64-3.27)
September 2004 NCOTeam.org 56
Outcomes: Improved QualityOutcomes: Improved Quality
• Participation helped NCOTeam Users Participation helped NCOTeam Users improve quality overall, including improve quality overall, including improved solutions to problems, mistakes improved solutions to problems, mistakes avoided, and re-work avoided (Means near avoided, and re-work avoided (Means near or above 4.0)or above 4.0)
September 2004 NCOTeam.org 57
Improved Quality: Comparison With Improved Quality: Comparison With Other UsersOther Users
• NCOTeam Users reported greater NCOTeam Users reported greater improvement in quality than Other Usersimprovement in quality than Other Users
• Other Users reported that participation in Other Users reported that participation in NCFs did not help them improve quality NCFs did not help them improve quality (Means from 2.48-2.70)(Means from 2.48-2.70)
September 2004 NCOTeam.org 58
Outcomes: Costs LoweredOutcomes: Costs Lowered
• NCOTeam Users reported that NCOTeam Users reported that participation did not help them lower costs participation did not help them lower costs muchmuch
• Other Users also reported that Other Users also reported that participation did not help them lower costs participation did not help them lower costs muchmuch
• Participation did not enable NCOTeam to Participation did not enable NCOTeam to lower costs more than Other Userslower costs more than Other Users
September 2004 NCOTeam.org 59
Outcomes: Easier AccessOutcomes: Easier Access
NCOTeam Users reported that participation NCOTeam Users reported that participation helped them helped them
• Get easier access to the expertise of Get easier access to the expertise of others, lessons learned and best practicesothers, lessons learned and best practices
• Get much easier access to these things Get much easier access to these things than Other Usersthan Other Users
September 2004 NCOTeam.org 60
Outcomes: Sources of ValueOutcomes: Sources of Value
• For NCOTeam UsersFor NCOTeam Users
– Learning, experts, and content were about equal as Learning, experts, and content were about equal as sources of valuesources of value
– Working with others was slightly less importantWorking with others was slightly less important
• Comparison to Other UsersComparison to Other Users
– Learning, experts, content, and working with others Learning, experts, content, and working with others were much greater sources of values for NCOTeam were much greater sources of values for NCOTeam Users than for Other UsersUsers than for Other Users
September 2004 NCOTeam.org 61
Outcomes: Innovation, Outcomes: Innovation, Learning/Knowledge, & RelationshipsLearning/Knowledge, & Relationships
• NCOTeam Users report a somewhat NCOTeam Users report a somewhat greater impact of participation in greater impact of participation in NCOTeam on innovation and learning NCOTeam on innovation and learning knowledge outcomes than on relationship knowledge outcomes than on relationship outcomes (Means exceeded 4.0)outcomes (Means exceeded 4.0)
• Other Users report that participation in Other Users report that participation in their NCFs did not help them as much to their NCFs did not help them as much to achieve these outcomesachieve these outcomes