User evaluation of a preferences portal for Cisco Unified products

Client - Cisco
Timeframe - Spring 2007
My Role - User Research

The product
A preferences portal and web application for managing the suite of Cisco Unified products

Method
Qualitative review of a high-fidelity prototype (web-based with Javascript)

Tools
Survey Monkey, Craigslist (recruiting), Audio/Video Capture using Morae software, Word, Excel

I was tasked with evaluating the design for a new product before the final UI specification was submitted. I worked with the primary interaction designer to determine the research goals, review the design specification, and determine timing. I also worked heavily with the UI engineer responsible for prototyping to direct which areas of the design specification needed to be built for testing, the level of interactivity, and the sample data to use. I then developed a recruiting screener based on the personas, recruited and scheduled participants from within the company, wrote the study plan, conducted the study, coded and compiled the results, and wrote up a summary document of findings. Finally, I converted all the videos from their proprietary format into .wmv files so that the designers who could not attend the sessions had a chance to review them.

Tags Qualitative Research



Project Artifacts
Study Plan
Recruiting Screener

User evaluation of a Unified Communications application

Client - Cisco
Timeframe - Dec. 2007
My Role - User Research

The product
A desktop application that increases user productivity by integrating Unified Communications services and video products.

Method
Qualitative review of a paper prototype

Tools
Survey Monkey, Craigslist (recruiting), Audio/Video Recording using Usability Lab equipment, Word, Excel

I was tasked with getting some early user feedback on a design for the next version of an existing product. I worked with the primary interaction designer to determine the research goals, review the design specification, and determine timing. I then developed a recruiting screener based on the personas, recruited and scheduled participants, wrote the study plan consisting of 11 tasks and associated open-ended questions, conducted the study, coded and compiled the results, and wrote up a summary document of findings.

Tags Qualitative Research



Project Artifacts
Study Plan
Subset of Coded Notes

International Icon Study

Client - Cisco
Timeframe - Spring 2007
My Role - study design, implementation, and analysis

The product
Validation of icon recognition across cultures

Method
online survey

Tools
Translation services, Google Translate, Survey Monkey, Word, Excel

As part of the design of the next generation VoIP desk phone, a series of new icons were created. Because of the international target audience, I was asked to determine whether users in other countries guessed the meaning of icons as accurately as the US audience had. The survey itself was simple enough; simply show the icon and ask what the person thinks it means. The challenge was that we didn't want to assume English fluency, so the survey instructions and content had to be translated as well as some of the results. Participants were recruited from Cisco International offices who were native speakers of the target languages (Arabic, Chinese, Korean, Japanese, German, and Spanish). Analysis was also time consuming due to the open answer format rather than multiple choice. Results were color coded in a spreadhseet determining how close the user's answer was to the true meaning of the icon (using green for right on, yellow for close, red when user had no idea).

Tags Surveys



Project Artifacts
Results Spreadsheet

Heuristic Evaluation

Client: Cisco
Timeframe: Spring 2007
The product: Application suite of phone tools
My Role:Installed and tested alpha release
Method: Heuristic evaluation
Tools:Nielsen's Heuristic Guidelines, Snag-it screen capture, Word, Excel

The product manager for this application wanted a quick and dirty evaluation of this application by the UI team. The product was in alpha, and completely unfamiliar to me. I was given only a marketing document that listed what the applications' features. From that, I attempted to duplicate the tasks a typical user would want to accomplish given those features and wrote up my findings along with recommendations.

Tags Heuristic Evaluation



Project Artifacts
Report Excerpts