HCDD 264 Quiz 2

what is stakeholder analysis?

People with an interest in your project; power, legitimacy, and the ability to get others' attention (positive or negative)

How to plan and run a successful data gathering program?

Plan and run an interview Design a simple questionnaire Plan and carry out an observation

types of analysis

Quantitative analysis - numerical methods to ascertain size, magnitude, amount, correlation, casual links Qualitative analysis - expresses the nature of elements and is represented as themes, patterns, or stories

Types of data: quantitative and qualitative

Quantitative data - numbers Qualitative data - texts, transcripts, photos, videos, etc.

Analytic tools to help stimulate grounded theory

Question the data Analyze words, phrases or sentence Comparisons between objects or abstract categories

Data Gathering: Questionnaires

Questions can be closed or open Closed questions are easier to analyze, and may be distributed and analyzed by computer They can be administered to large populations Disseminated by paper, email, and the web Sampling can be a problem when the size of a population is unknown as is common with online evaluation

Data Gathering: Online Questionnaires

Relatively easy and quick to distribute Responses are usually received quickly No copying and postage costs Data can be collected in database for analysis Time required for data analysis is reduced Errors can be corrected easily

Grounded Theory

Seeks to develop theory from systematic analysis of empirical data Three levels of 'coding' ---Open: identify categories ---Axial: flesh out and link to subcategories ---Selective: form theoretical scheme Researchers are encouraged to draw on own theoretical backgrounds to inform analysis

Data Gathering: Questionnaire Design

The impact of a question can be influenced by question order You may need different versions of the questionnaire for different populations Provide clear instructions on how to complete the questionnaire Strike a balance between using white space and keeping the questionnaire compact Avoid very long questions and questionnaires Decide on whether phrases will all be positive, all negative, or mixed

Double diamond problem

Think broadly think ideas (diverge) --> narrow down (converge) Think broadly about solutions (diverge) --> narrow down (converge)

Data Gathering: Observation Guides

Three easy-to-remember parts: -The person: Who? -The place: Where? -The thing: What?

Data Gathering: Interview Questions

Two types Closed questions have a predetermined answer format (yes or no, a number) -Not very rich -Quality based on the question -Easier to analyze Open questions do not have a predetermined format -Quality based more on interviewee -Richer data

How pragmatic are UK and USA regarding participatory design?

UK participatory design - more pragmatic USA participatory design - even more pragmatic It just works better

Why do stakeholder analysis?

Understand the human/social ecosystem in which your venture operates, and in which your product is used Implications for design

What is the process of Interaction Design?

Understand the problem space Identify the users Identify their needs Generate alternative designs Choose among alternative designs Produce prototypes Evaluate prototypes

Data Gathering: interview types

Unstructured: not directly by a script. Rich but not replicable Structured: tightly scripted, often like a questionnaire Replicable but may lack richness Semi-structured: Guided by a script, but interesting issues can be explored in more depth Can provide a good balance between richness and replicability Goldilocks problem ---Incorporate follow-on or probe questions --Ex. eliciting scenarios Focus group: a group interview --Have to talk to everyone because certain people tend to dominate

Co-design: 'buts'

Users rarely know what is possible Instead:Explore the problem spaceInvestigate who are the usersInvestigate user activities to see what can be improvedTry out ideas with potential users Focus on peoples' goals, usability, and user experience goals, rather than expect stakeholders to articulate requirements

Co-design

involving users and other stakeholders in the design process

Participatory Design

involving users and stakeholders in the design process

what is satisfying?

look for first solution they think will work, not necessarily the best solution -If you're spending a lot of money to fix something want to spend time thinking of best solutions -We tend to latch on the first idea we think will work especially as the problem area become more complex

how do we do stakeholder analysis?

quad chart interest (y axis). subjects. players power(x axis). crowd. context setters.

Data Gathering: Questionnaire Response Format

'Yes' or 'No' checkboxes Checkboxes that offer many options -Rating scales -Likert scales -Semantic scales -3, 5, 7 or more points Open-ended responses

Selecting from among alternative solutions

-Interaction design focuses on externally visible and measurable behavior -Technical feasibility -Evaluation with users or peers ---Prototypes not static documentation because behavior is key -A/B testing ---Online method to inform choice between alternatives ---Nontrivial to set appropriate metrics and choose user group sets -Quality thresholds ---Different stakeholder groups have different quality thresholds ---Usability and user experience goals lead to relevant criteria Object measures: How long does it take? How many errors do they make?

what should you avoid in interview questions?

-Long questions -Jargon and language that the interviewee may not understand -Leading questions that make assumptions, for example, why do you like...? -Unconscious biases, for instance, gender stereotypes

how did participatory design come to be?

A Scandinavian movement of the 1960s and 1970sMore effective communication about technology in the workplaceA more democratic approach to adopting technologyWorker rights decide on technology-driven changes to work

Customer journey maps

A UX/product ecosystem phase analysis: How do prospective customers/users become aware of your product? How do they research a potential acquisition?How do they actually acquire it? What is their out-of-the-box experience? --Apple has good out-of-the box experience -----Make it good so they will want it again --Amazon does not

Data Gathering: Interview Props

Devices for prompting an interviewee, for example, use a persona, scenario, use case, prototype

Data Gathering: Remote Interviews

Digital conferencing systems such as Skype, Zoom, email, and smartphones can be used to conduct interviews. Some advantages are: Participants are in their own environment so are more relaxed Participants don't need to travel Participants don't need to worry about what to wear For interviews involving sensitive issues, it is easier for interviewees to be anonymous Auto transcription

Data Gathering: Observation

Direct observation in the field --Structuring frameworks --Degree of participation (insider or outsider) --Ethnography Direct observation in controlled environments Indirect observation: tracking users' activities --Diaries --Interaction logging --Video and photographs collected remotely by drones or other equipment

Generating alternative solutions

Humans tend to stick with something that works Considering alternatives helps identify better designs Where do alternative designs come from?'flair and creativity': research and synthesisCross-fertilization of ideas from different perspectivesUsers can generate different designsProduct evolution based on changing use Seek inspiration: similar products and domain, or different products and domain Balancing constraints and trade-offs

Basic qualitative analysis

Identify --Quotes --Categories --Counts --Interpretations Critical incidents Categorizing data --Categorization scheme pre-specified or emergent Identifying themes --Emergent from data, dependent on analysis framework if used

what should you focus on in co-design?

Focus on peoples' goals, usability, and user experience goals, rather than expect stakeholders to articulate requirements

basic quantitative analysis

Averages: --Mean - add up values and divide by number of data points --Median - middle value of data when ranked --Mode - figure that appears most often in the data Percentages Be careful not to mislead with numbers Graphical representations give overview of data

qualitative analysis

Collect data --> reduce the data --> display the data --> what are the conclusions from that data

Data Gathering: Interview Recording

Notes, audio, video, and photographs can be used individually or in combination: Notes plus photographs Audio plus photographs Video Different challenges and advantages with each type of data recording

Why use co-design?

Expectation management Realistic expectations No surprise, no disappointments Timely training Communication, but no hype Ownership Make the users active stakeholders More likely to forgive or accept problems You want people to adopt your product Can make big difference in acceptance and success of a product

Data Gathering: Questionnaire Response Rates

Make sure that the purpose of study is clear Promise anonymity Ensure that questionnaire is well designed Offer a short version for those who do not have time to complete a long questionnaire If mailed, include a stamped, addressed envelop Follow-up with emails, phone calls, or letters Provide an incentive 40% response rate is good, 20% is often acceptable

Kinds of co-design

Member of the design teamFull time - constant input, but lose touch with usersPart time - patchy input, and very stressfulShort term - inconsistent across project lifeLong term - consistent, but lose touch with users Face-to-face group or individual activities Online contributions from thousands of usersOnline Feedback Exchange (OFE) systemsCrowdsourcing design ideasCitizen science User involvement after product release

What are key issues in data gathering?

Setting goals --Decide how to analyze data once collected Identifying participants --Decide from whom to gather data --How many participants are needed ----Ex. can't do study about how tazing in class would reduce phone use ----Ethical dimension of study design they need to know that they are being watched/studied --Think about their background and demographics Relationship with participants --Clear and professional --Informed consent when appropriate Triangulation --Look at data from more than one perspective --Collect more than one type of data, for instance, quantitative data from experiments and qualitative data from interviews Pilot studies --Small trial of main study

A more detailed framework

Space: What is the physical space like and how is it laid out? Actors: What are the names and relevant details of the people involved? Activities: What are the actors doing and why? Objects: What physical objects are present, such as furniture? Acts: What are specific individual actions? Events: Is what you observe part of a special event? Time: What is the sequence of events? Goals: What are the actors trying to accomplish? Feelings: What is the mood of the group and of individuals?

what are the row categories of journey maps?

activities motivations questions barriers

what are the col categories of journey maps?

awareness research acquire OOBE