NCSU Libraries Rapid user testing with prototypesTRLN Annual Meeting – July 2010Susan Teague Rector & Angie Ballard1
What we testedDo users navigate using the expected menu items?Do users pre-select tabs in a tabbed search box before entering search terms?How do users interact with tabbed or non-tabbed search results?2
MethodologyUsers were recruited in situ in the library lobbyNavigation TestingSearch Box TestingUsers were asked to complete 4 of 15 tasks using a working prototype of navigation menus only.Each task required the user to open a navigation menu and indicate which menu item they would select to look for the specified information.Facilitators recorded up to 4 of each user’s menu selections, in order of selection.3Each participant completed 2 tasks using one of the 2 search models; many participants volunteered to answer more than 2 questions.Facilitators documentedtab the participant initially selectedsearch term(s) usedpath taken to complete the task,whether the participant used the  default ‘All’ tab only, silos only or both. A facilitator assessment of task difficulty was recorded for both tests
Test Setup4Used candy bars as incentives2 laptops with browsers open to prototypeCycled through 15 tasks; 2-4 tasks per user in five minute sessionsD. H. Hill Lobby
Response RateTotal of 32 participants in 2 hours24 Undergraduates3 Graduates2  Staff1 Visitor2 Library Staff MembersTotal of 28 participants in 4 hours22 Undergraduates3 Graduates2 Library Staff Members1 Non-Traditional StudentNavigation TestingSearch Box Testing5
Take AwaysRapid testing:Yields more feedback in less time.Best for testing specific features.Tests should last no more than 5 minutes.Saves resources for recruiting, scheduling, logistics, testing, and compensation.Does not save research planning & analysis time.6
Take AwaysInformal test environment may mean more realistic user interactions with product.Results are somewhat skewed toward users who use the physical space.Should be balanced with results from other types of testing.Helps uncover areas for further testing.7
Results & full presentation	http://news.lib.ncsu.edu/redesign/2010/04/22/usability-testing/8
Thank you!Questions? susan_teague_rector@ncsu.eduangie_ballard@ncsu.edu9

More Related Content

PPT
NCSU Libraries: Rapid user testing with prototypes
PPTX
Eastwood presentation on_kellyetal2010
PPTX
Farnoush Ghaheri , Using Video in Action Research
PDF
Technical Bulletin 0213 Polyisocyanurate vs. Cellular Glass Insulation
PDF
Customer Bulletin 0515 A Comparison of ISO ISO-C1 and HT-300
PPT
Driving lessons
PPT
Presidian Management Services 512 S
PPT
Shenzhen 101 Industrial Design Co., Ltd.
NCSU Libraries: Rapid user testing with prototypes
Eastwood presentation on_kellyetal2010
Farnoush Ghaheri , Using Video in Action Research
Technical Bulletin 0213 Polyisocyanurate vs. Cellular Glass Insulation
Customer Bulletin 0515 A Comparison of ISO ISO-C1 and HT-300
Driving lessons
Presidian Management Services 512 S
Shenzhen 101 Industrial Design Co., Ltd.

Similar to Trln (20)

PPT
NCSU Libraries: Rapid user testing with prototypes
PPTX
NCSU Libraries Usability Testing
PPT
User Research on a Shoestring
PPT
NCSU Libraries 2010 Web site Redesign: Process & Progress
PDF
Usability Techniques for Startups
PDF
Is Mobile Really Necessary?
PPTX
“Usability Testing of a Library Web Site: Librarians and Anthropologists Work...
PPT
Usability Testing: A Brief Introduction for the Novice
PPT
Intranet Usability Testing
PDF
How to Conduct Usability Studies: A Librarian Primer
PDF
Library Usability
PPT
Taking the Reins: Website Redesign by the Librarians, for the Users
PPT
Barcamp Bangalore 2 - On User Experience and Usability Testing
PPT
Usability evaluations (part 2)
PPTX
D4D session d21 - Really baking it in integrating the ux design process with...
PPTX
User Experience in Libraries
PPT
Don’t make me think!
PDF
Creating User-Centered Website Navigation
PPTX
Usability evaluation methods (part 2) and performance metrics
PDF
Usability testing – Just Do It. Five methods for improving usability in-house
NCSU Libraries: Rapid user testing with prototypes
NCSU Libraries Usability Testing
User Research on a Shoestring
NCSU Libraries 2010 Web site Redesign: Process & Progress
Usability Techniques for Startups
Is Mobile Really Necessary?
“Usability Testing of a Library Web Site: Librarians and Anthropologists Work...
Usability Testing: A Brief Introduction for the Novice
Intranet Usability Testing
How to Conduct Usability Studies: A Librarian Primer
Library Usability
Taking the Reins: Website Redesign by the Librarians, for the Users
Barcamp Bangalore 2 - On User Experience and Usability Testing
Usability evaluations (part 2)
D4D session d21 - Really baking it in integrating the ux design process with...
User Experience in Libraries
Don’t make me think!
Creating User-Centered Website Navigation
Usability evaluation methods (part 2) and performance metrics
Usability testing – Just Do It. Five methods for improving usability in-house
Ad

More from teaguese (10)

PPTX
Librarian UXUnConference
PPT
Internet librarian v9
PDF
TTYL IRL :) : Strategies and Tools for Remote Library Teams
PPT
Live Usability Lab ELUNA 2008: Long Beach California
PPT
Location, location, location: A transaction comparison of catalog searches ...
PPT
Best practices for building usable & accessible Web content
PPT
Web 2.0 In a Nutshell : A Librarian Guide to the World of Web 2.0
PPT
Best practices for building usable & accessible Web content
PPT
Location, location, location: A transaction comparison of catalog searches o...
PPTX
Trln
Librarian UXUnConference
Internet librarian v9
TTYL IRL :) : Strategies and Tools for Remote Library Teams
Live Usability Lab ELUNA 2008: Long Beach California
Location, location, location: A transaction comparison of catalog searches ...
Best practices for building usable & accessible Web content
Web 2.0 In a Nutshell : A Librarian Guide to the World of Web 2.0
Best practices for building usable & accessible Web content
Location, location, location: A transaction comparison of catalog searches o...
Trln
Ad

Trln

  • 1. NCSU Libraries Rapid user testing with prototypesTRLN Annual Meeting – July 2010Susan Teague Rector & Angie Ballard1
  • 2. What we testedDo users navigate using the expected menu items?Do users pre-select tabs in a tabbed search box before entering search terms?How do users interact with tabbed or non-tabbed search results?2
  • 3. MethodologyUsers were recruited in situ in the library lobbyNavigation TestingSearch Box TestingUsers were asked to complete 4 of 15 tasks using a working prototype of navigation menus only.Each task required the user to open a navigation menu and indicate which menu item they would select to look for the specified information.Facilitators recorded up to 4 of each user’s menu selections, in order of selection.3Each participant completed 2 tasks using one of the 2 search models; many participants volunteered to answer more than 2 questions.Facilitators documentedtab the participant initially selectedsearch term(s) usedpath taken to complete the task,whether the participant used the default ‘All’ tab only, silos only or both. A facilitator assessment of task difficulty was recorded for both tests
  • 4. Test Setup4Used candy bars as incentives2 laptops with browsers open to prototypeCycled through 15 tasks; 2-4 tasks per user in five minute sessionsD. H. Hill Lobby
  • 5. Response RateTotal of 32 participants in 2 hours24 Undergraduates3 Graduates2 Staff1 Visitor2 Library Staff MembersTotal of 28 participants in 4 hours22 Undergraduates3 Graduates2 Library Staff Members1 Non-Traditional StudentNavigation TestingSearch Box Testing5
  • 6. Take AwaysRapid testing:Yields more feedback in less time.Best for testing specific features.Tests should last no more than 5 minutes.Saves resources for recruiting, scheduling, logistics, testing, and compensation.Does not save research planning & analysis time.6
  • 7. Take AwaysInformal test environment may mean more realistic user interactions with product.Results are somewhat skewed toward users who use the physical space.Should be balanced with results from other types of testing.Helps uncover areas for further testing.7
  • 8. Results & full presentation http://news.lib.ncsu.edu/redesign/2010/04/22/usability-testing/8