Example questionnaire for participants of the Semantic Digital Libraries evaluation using DSpace
11
Semantic Digital Libraries Evaluation Results of Anna Karpinska (DSpace) Pre-Evaluation Questionnaire 1. Your age < 20 21 - 25 26 - 30 31 - 35 36 - 40 > 40 2. Your education under- grad BSc MSc PhD Other 3. Main domain of education / research Informatics / Computer Science Electronics / Telecommunications Business / Marketing Fine Arts / Architecture Life Science / Social Science Bio-Chemistry Maths / Physics Other 4. How often do you visit the university library? (slide the X marks on the lines below) at least once a day at least once a week at least once a month more seldom 5. How often do you visit the university digital library? (slide the X marks on the lines below) at least once a day at least once a week at least once a month more seldom
Transcript
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 1 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
Semantic Digital Libraries Evaluation
Results of Anna Karpinska (DSpace)
Pre-Evaluation Questionnaire
1. Your age
< 20
21 - 25
26 - 30
31 - 35
36 - 40
> 40
2. Your education
under-grad
BSc
MSc
PhD
Other
3. Main domain of education / research
Informatics / Computer Science
Electronics / Telecommunications
Business / Marketing
Fine Arts / Architecture
Life Science / Social Science
Bio-Chemistry
Maths / Physics
Other
4. How often do you visit the university library? (slide the X marks on the lines below)
at leastonce aday
at leastonce aweek
at leastonce amonth
moreseldom
5. How often do you visit the university digital library? (slide the X marks on the lines below)
at leastonce aday
at leastonce aweek
at leastonce amonth
moreseldom
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 2 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
6. Do you know what social tagging is?
Yes
No
7. Do you use any online bookmarking system? (If yes - name up to 3 most often used.)
Yes
No
8. Are you subscribed to any online social networking site? (If yes - name up to 3 most oftenused.)
Yes
No
9. Have you ever come across the term “Web 2.0”? Do you know what it means?
Yes
No
10. Have you ever come across the term “Semantic Web”? Do you know what it means?
Yes
No
Questionnaire After the Initial Task
1. What is your general first impression about the system? (slide the X marks on the linesbelow)
hard to use easy to use
complex, mind boggling simple, clearly organized
hard to master,unintuitive
intuitive, straightforward
boring interesting
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 3 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
ugly, unattractive attractive
useless useful, handy
2. How did you find the task of registering to the digital library? (slide the X marks on thelines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
3. How did you find the task of finding publications described with either of two givenkeywords: ''web services'' and ''semantic web''? (slide the X marks on the lines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
4. How did you find the task of finding ''publications about notitio.us'' ? (slide the X markson the lines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
5. How did you find the task of bookmarking articles about notitio.us ? (slide the X marks onthe lines below)
hard to understand easy to understand
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 4 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
6. Please describe how (using which system) did you bookmark articles about notitio.us.(Please, provide a link to the bookmarking services if you used an online bookmarkingsolution, outside of the digital library.)
I didn't
7. Do you have any comments to this part of the evaluation?
No
First Task
Question: Which personality features are considered to be the factors increasing theusage of the Internet (and for which purposes)?(PL: Ktore cechy osobowosci uwaza sie czynniki zwiekszajace wykorzystywanie sieciinternetowej (do jakich celow)?)
1. How did you find the task of finding information in the digital library? (slide the X markson the lines below)
hard to understand easy to understand
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 5 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
2. How do you find search feature in the digital library? (slide the X marks on the linesbelow)
hard to use easy to use
complex, mind boggling simple, clearly organized
hard to master,unintuitive
intuitive, straightforward
boring interesting
ugly, unattractive attractive
useless useful, handy
3. Do you have any comments to this part of the evaluation?
Second Task
Question: What (credibility) dimension are used to evaluate the credibility of theinformation on the Internet (used in the research)?(PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej(wykorzystywane w badaniach)?)
Answer:
To evaluate credibility of the information on the Internet * believability * accuracy *trustworthiness * bias * completeness. "The Yale group defined credibility in terms ofspeaker's expertise (as web coprehesiveness of a Web information) and trustworthiness (asweb site's integrality)" but also dynamism, composure and sociability.
References:
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 6 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
1. How did you find the task of finding information in the digital library? (slide the X markson the lines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
2. How do you find search feature in the digital library? (slide the X marks on the linesbelow)
hard to use easy to use
complex, mind boggling simple, clearly organized
hard to master,unintuitive
intuitive, straightforward
boring interesting
ugly, unattractive attractive
useless useful, handy
3. Do you have any comments to this part of the evaluation?
No
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 7 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
Third Task
Question: Based on the results of the research, what is the credibility of the Internet andinformation delivered by it, compared to the credibility of other media sources?(PL: Jak oceniana jest, na podstawie wynikow badan, wiarygodnosc Internetu i informacji zniego pochodzacych w porownaniu z wiarygodnoscia innych mediow?)
Answer:
"Students in this study reported that they perceived the Internet to be moderately tosomewhat credible (M=4.09, S.D.=0.82), although less credible than newspapers,television, and magazines. Compared to the nonstudent sample the students found allinformation channels to be more credible than did the nonstudents, as indicated by asignificant between-subjects (student status) effect in a repeated-measures ANOVA." <>
It was easy to find articles, but difficult to find sth in it. To less time to right good essay aboutit.
Evaluation Questionnaire after the Third Task
1. How did you find the task of finding information in the digital library? (slide the X markson the lines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
2. How do you find search feature in the digital library? (slide the X marks on the linesbelow)
hard to use easy to use
complex, mind boggling simple, clearly organized
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 8 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
hard to master,unintuitive
intuitive, straightforward
boring interesting
ugly, unattractive attractive
useless useful, handy
3. Do you have any comments to this part of the evaluation?
no
Post-Evaluation Questionnaire
1. What is your overall impression about the DL library you used? (slide the X marks on thelines below)
hard to use easy to use
complex, mind boggling simple, clearly organized
hard to master,unintuitive
intuitive, straightforward
boring interesting
ugly, unattractive attractive
useless useful, handy
2. “I think, I would perform better if only ...” (complete the sentence)
there was better funcionality of finding more information insidearticles. It's easy to find sth connected to subject, but in most casesit don't help in find an answer I needed.
25/01/2008 16:36Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 9 of 9http://localhost:8080/questionnaire/quest/complete?_u=niusianusia
3. Would you like to continue using this digital library (DSpace)? (Say why)
Yes
No
I have a feeling that it will be easier to find an answer to thatquestions in google. I mean that their search engine is more"semantic" than Dspace. In this case I would prefer to get paperarticle than read it on the screen to find my answer.
4. Do you have any comments to this part of the evaluation?
no
[Main Page]
02/03/2008 14:37Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 1 of 2http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia
Semantic Digital Libraries Evaluation
Results of Anna Karpinska (DSpace)
Memory Task
Question: What (credibility) dimension are used to evaluate the credibility of theinformation on the Internet (used in the research)?(PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej(wykorzystywane w badaniach)?)Answer:
I think there was 5 of them, but I'm not sure. I can't tell which
References:
Comment:
After this time it is very difficult to answer any question
Evaluation Questionnaire after the Memory Task
1. How did you find the task of recalling previously learned information? (slide the X markson the lines below)
hard to understand easy to understand
hard to execute easy to execute
hard to master,unintuitive
intuitive, straightforward
2. “I think, I would perform better if only ...” (complete the sentence)
There was more sematics in it. This time my search look like google search and it was not enough time to give a good answer.
02/03/2008 14:37Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace)
Page 2 of 2http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia
3. Do you have any comments to this part of the evaluation?
