Cognitive Ethnography Project

Informed Consent Form | Project Calendar

The purpose of this project is to develop the observational and analytical methods of cognitive ethnography. The project is broken up into multiple components, most of which build on each other in some important way, and all of which emphasize important skills and techniques for the cognitive ethnographer. For each major stage, we will practice peer review of the written products.

The key components of this project are:

  1. Cognitive Diary
  2. Selection of a Field Site
  3. Human Subjects Ethics Training
  4. Introduction to the Field Site
  5. Observation and Field Notes
  6. Photo Documentation
  7. Interview and Transcription
  8. Cultural Models Analysis
  9. Video Documentation and Enhanced Transcription
  10. Multi-modal Cognitive-Ethnographic Analysis

Cognitive Diary

Goals

In this assignment, you will learn to think about the nature of cognitive tasks in everyday life and how they can be analyzed by observing your own daily cognitive activities. This assignment will also introduce you to the writing and peer-review process that we will use in this course.

Directions

  1. Keep a “cognitive diary” for an entire day. Whenever you engage in some kind of cognitive task – i.e., something that requires you to think, plan, remember, or problem-solve – try to notice it and make a record of it (jot it down, dictate to tape recorder, etc.). You are not required to turn in the diary itself, but you are required to do one.
  2. Choose an everyday cognitive activity from your diary to describe in detail. Choose carefully. Keep it small and simple. It may be part of your job, or part of a recreational activity, or part of your everyday routine. It should be something that you would have done even if you were not taking this class. Do not attempt to describe a personal relationship, or a private activity, or your reasoning about it. Do not attempt to design an “experiment.” Don’t worry about how representative the activity is.
  3. Description: Describe the cognitive activity as carefully as you can. Begin by describing only those things that can be seen “from the outside,” i.e., could be captured on video or described by an observer.
  4. Analysis: Start by answering the question: What is “cognitive” about the activity? Some of the questions you might be able to answer include the following: What function does the cognitive activity perform? What concepts or information does the activity make use of? How does the activity take advantage of or interact with structure in the environment? Is the activity a common routine, and if so, in what ways? Look for cognitive shortcuts – ways of making a complicated computation into a simple one.
  5. You’re analyzing the activity, but only by analyzing your description of observable phenomena. Minimize or avoid first-personal descriptions of “what is going through my mind” or “what was going on in my head.” Such things are not available to cognitive researchers, and you may know much less about them than you think!
  6. Use the readings for inspiration! Also, feel free to make citations to the readings when you feel that they support your analysis.

N/A

Write Up

Your write-up should be between 500-800 Words, formatted as you think appropriate. DO include a title for your write-up. DO NOT include any identifying information in the essay itself (i.e., no name, UTD-ID, etc.), in order to prepare your paper for anonymous peer review. Proofread carefully and ensure your draft is substantially free of grammatical and spelling errors.

Draft due: 1/25 at 11:59pm (via Turnitin)

Peer Review Instructions

The peer review period will be from 1/26-1/29. We will devote some time to working on this in class. You will read and review the write-ups of two of your classmates. You should feel free to mark grammatical issues etc., but you should focus on the intellectual content of your peer’s write-up, and provide feedback that will help them improve it. Make sure they followed directions and that their write-up includes all the required components. Please provide detailed feedback.

Pay special attention to the following questions:

  1. Did the author choose an appropriate activity? Is it genuinely cognitive? I.e., does it involve problem-solving, inquiry, information-processing, or something similar?
  2. If the task is cognitive, does it have a cognitive goal, or is the cognitive component merely a sub-task, i.e., a part of the overall activity?
  3. Does the text focus on a single event of a small enough scale to engage the details? Is their description detailed enough? In what ways could it be more detailed?
  4. Does the text violate the terms of the assignment by describing a personal relationship or a private or illegal activity?
  5. Does the text make a clear distinction between description and analysis?
    Or do they sneak in their interpretations of the cognitive activity into the basic description? How could they avoid this?
  6. Does the description stick to observable phenomena? Or do they describe things about the activity that could not be observed by an external party, such as complex mental / brain processes? How could they avoid this?
  7. Are the claims in the analysis supported by observations that appear in the description?
  8. Does the text mention concepts from the readings or lectures? Does it use them well? Could other concepts help their analysis? Which ones?
  9. Overall, how would you rate this text?
  10. What other improvements can you suggest?

Final Due Date: 2/1 at 11:59pm

Back to top

Selection of a Field Site

Goals

The goal of this assignment is to select a suitable field site to conduct your cognitive ethnography research. This is an extremely important prerequisite to the rest of your work for the term. You will spend at least a few hours at for field site each week during the term.

Directions

A good field site must meet several requirements:

  1. It must be persistent, such that you can continue to observe it throughout the semester, and it must have a persistent group of participants who will consent to participate in the ethnography project.
  2. It must have a cognitive task or involve a lot of cognitively intensive sub-tasks.
  3. It must involve a group working together, face to face, in a setting, with particular equipment or tools.
  4. It should not involve private, dangerous, embarrassing, or illegal activities that it would endanger you or your subjects for you to observe.

The field site should involve activities that would occur even if you were not taking this class. Do not attempt an “experiment” and don’t worry about how “representative” the activity is.

For instance, you might choose:

  • A science or engineering lab on campus
  • A small workplace (or working group in a larger workplace)
  • A classroom that involves frequent group activities
  • A group playing a difficult game

For those who are interested, I will be happy to assist you in connecting with a science or engineering research lab on campus as a possible field site.

You will not need to get informed consent yet, but you should talk to the participants to make sure they will be willing to participate in the rest of the project.

Write Up

List and describe 3-4 field sites, and explain briefly how they fit the conditions above.

Draft due: 2/1

Peer Review Instructions

Peer review will be conducted in class. Some of you will need to consult with me out of class about your field site.

You should settle on a top choice and an alternate for the final due date.

Final Due Date: 2/8

Back to top

Human Subjects Ethics Training

Goals

The goal of this assignment is to learn how to conduct ethically responsible research involving human subjects.

Directions

  1. Log in to eLearning.
  2. Select “Human Subjects Protection”
  3. Complete the online Human Subjects Training.
  4. Save the certificate of completion as a PDF and upload it to Turnitin.

You must complete this assignment and TURN IT IN before you can conduct ANY research at your field site. You are welcome to turn it in early.

Final Due Date: 2/15

Back to top

Introduction to the Field Site

Goals

The goal of this assignment is to familiarize yourself with your field site, develop rapport with the participants, and to get their informed consent to participate in the project.

Directions

  1. Set up a regular weekly time with your informants to visit the field site and conduct your observations. You should pick a time when many of the participants will be actively engaged.
  2. Meet the participants, and review the informed consent forms with them. Answer any questions they raise about the study. Ask them questions to make sure they understand the study they are consenting to.
  3. Give the participants a copy of the informed consent form to keep, and have them sign a second copy.
  4. Get to know the field site and the participants. You need not take any formal field notes, but feel free to talk notes as needed.
  5. If appropriate, volunteer to participate in non-technical but helpful elements of the group activity.

It is essential that you obtain informed consent from all of the participants at the field site before continuing the study there. If the members of this field site do not consent to the research, you will have to pick an alternative site. Review the text of the informed consent form with each participant, answer any questions they have, and ask them specific questions about its content to make sure they understand what they are consenting to. Make sure you bring 2 copies of the consent form for each participant, so they will have a form to take home with them.

Write Up

Your write-up should be between 300-600 Words. You should write up your general impressions and reflections on your field site, the participants, and their cognitive activities. Do not include any identifying information about the participants. (This assignment is not peer reviewed.)

Turn in your signed informed consent forms in class by 3/2.

Final Due Date: 2/29

Back to top

Observation, Field Notes, and Analysis

Goals

The goals of this assignment are to learn to observe cognition in the wild, describe your observations, and analyze your description. This is a chance for you to learn about how people use their minds in everyday activities and to analyze the cognitive details of those activities.

Directions

  1. Observe: Visit your field site and carefully watch every action your participants do, taking appropriate fieldnotes as you watch. If taking notes would be awkward or inappropriate during the activity, wait until the end of your observation session, and then immediately write down what you observed. It is worthwhile to take your jot notes immediately after your observation session and type them up into formal fieldnotes. (There are many guides to and templates for writing fieldnotes that yo can find online. Pick a form that works for you.) Your observations don’t have to be continuous but can be broken into multiple observation sessions.
  2. Describe: Choose a single cognitive activity from your field notes to describe in more detail. The more numerous and more diverse the events you captured in your notes, the easier it will be to choose one that you can use to demonstrate your mastery of description and cognitive analysis.Describe the cognitive activity as carefully as you can. Go slowly; be patient and methodical. Describe what actually happened in this particular instance rather than generalizing about multiple events. Describe only observable phenomena. These include relevant objects in the environment (cognitive artifacts), specific bodily actions and positions with respect to these objects, and specific speech uttered. Do not describe any internal, unobservable phenomena such as “remembering,” “wanting,” etc.For example, rather than writing “She chopped the tomatoes;” you should write: “She held the tomato with her left hand, three fingers wrapped around the far side with her pinky on the cutting board. She held the knife in her right hand with her elbow away from her body and her head down, and sliced the tomato into 1⁄4 inch slices. She exhaled each time she brought the knife down.” This is the right level of detail.
  3. Analyze: In the analysis you will address the question: “What is ‘cognitive’ about this activity?” That is, how does the activity accomplish a cognitive function such as planning, problem solving, decision making, understanding, control of action, and so on. Some of the questions you might be able to answer include the following: How does the activity take advantage of or interact with structure in the environment? If the activity is engaged in frequently (you will have to rely on general ethnography to establish this), is there evidence that it has become ‘routine’ in the sense described by Lave et al. 1984? Look for cognitive shortcuts, that is, ways of making a complicated computation into a simple one, or ways of leaving out parts of an activity that previously seemed necessary.Resist the temptation to describe what your participant was “thinking.” Some of the processes that you might have assumed were internal will turn out on closer inspection to exist in the interaction of bodies with the world. Be sure not to miss these by prematurely looking for explanations in the head. Try to give cognitive interpretations of the activities you see, rather than positing cognitive causes of those activities.Notice that what you analyze is your description of the chosen event, not the event itself. Your analysis cannot refer to aspects of the event that do not appear in the description. So, write the description first. Then, as you develop the analysis you may discover or remember aspects of the event that you observed, but neglected to describe. You should continue to refine the description as you develop and refine the analysis. The description and analysis should fit each other.

If any new participants of the field site are present in your subsequent observations, you need to obtain their informed consent as well. You should bring spare informed consent form to your field site each week. If you recruit new participants, turn those forms in to the Professor by the following class. Participants who do not give their consent can not be included in your observation or analysis.

Write Up

Your write-up should be 700-1000 words, prepared for peer review. Your write-up should include both your description and analysis, clearly distinguished.

Draft due: 3/7

Peer Review Instructions

The peer review period will be from 3/8-3/11. You will read and review the write-ups of three of your classmates. You should feel free to mark grammatical issues etc., but you should focus on the intellectual content of your peer’s write-up, and provide feedback that will help them improve it. Make sure they followed directions and that their write-up includes all the required components.

Pay special attention to the following questions:

  1. Did the author choose an appropriate activity? Is it genuinely cognitive?
  2. Does the text focus on a single event of a small enough scale to engage the details? Is their description detailed enough? In what ways could it be more detailed?
  3. Does the text violate the terms of the IRB protocol by describing a personal relationship or a private or illegal activity?
  4. Does the text make a clear distinction between description and analysis?
    Or do they sneak in their interpretations of the cognitive activity into the basic description? How could they avoid this?
  5. Does the description stick to observable phenomena? Or do they describe things about the activity that could not be observed by an external party, such as complex mental / brain processes? How could they avoid this?
  6. Does their analysis adequately explain what is cognitive about the activity?
  7. Are the claims in the analysis supported by observations that appear in the description?
  8. Does the text mention concepts from the readings or lectures? Does it use them well? Could other concepts help their analysis? Which ones?
  9. Overall, how would you rate this text?
  10. What other improvements can you suggest?

Final Due Date: 3/14

Back to top

Photo Documentation and Analysis

Goals

The goal of this assignment is to learn how to attend to the cognitive details of the everyday world, and to document the visible aspects of cognition in the wild using photography, as well as learning how to analyze photographic evidence to interpret the cognitive elements of environments and activities.

Directions

  1. Take pictures of the activity. Try to capture interesting aspects of the activity and the social and material environment in which it takes place. Take a good number of shots so you will have plenty to choose from later. Make sure your subjects are comfortable with what you are taking pictures of.
  2. Carefully look at your pictures and choose two of them that you find most interesting.
  3. Carefully describe what you see in the two photos. Stick close to the data and pay attention. Look for evidence of cognitive activity. Hopefully, you will see things in the study of your photos that you did not see while observing the event live.
  4. Analyze the photographs in order to answer the question, “What is ‘cognitive’ here?” The analysis should explain how the visible features of the images you described are related to cognitive processes or accomplishments such as planning, problem solving, decision making, understanding, control of action, and so on. While you should include the images in the document you turn in, you should also make sure that the elements that you base your analysis on are present in your description.

If any new participants of the field site are present in your subsequent observations, you need to obtain their informed consent as well, and turn those forms in to the Professor. Participants who do not give their consent can not be included in your observation or analysis.

Write Up

700-1000 words of text, plus the two photos, which should include your description and your analysis. Prepare your write-up for anonymous peer review.

Final Due Date: 3/14

Back to top

Cognitive-Ethnographic Interview and Transcription

Goals

To learn how to conduct an interview, and transcribe an audio recording.

Directions

  1. For this project you will need some sort of audio recorder (video is okay as well, but you’ll only be using it for its ability to collect audio). This might be a tape recorder or an app for your phone. Make sure you know how it works before your interview, and that it will record for at least 60 minutes.
  2. Before interviewing, read Ed Hutchins’ interviewing tips and potential interview questions and read Lindlof & Taylor’s discussion of Qualitative Interviews.
  3. Identify a participant in the activity from your field site who is willing to talk to you about the activity.
  4. Set up a time and a quiet place to talk to your informant.
  5. Turn on the recorder and interview your informant about the activity you took field notes and photos of. You should start with the photos you used in the previous part, but feel free to use other photos as prompts in the interview. Ask your informant to explain what is going on in the activity.
  6. Ask followup questions based on their answer, probing further into details as long as it is productive to do so. Then ask about different aspects of the activity.
  7. Record at least 30 minutes, but no more than one hour of interview.
  8. Listen through your interview and make an index of what it contains. This should be a list of topics discussed or events in the conversation with some indication of where they appear on the recording. Your index should be split up according to the content of the interview, but it should not be less than one entry per five minutes. Choose one or two passages to transcribe based on your indexing.
  9. Transcribe about 1000 words using relaxed transcription techniques. For this, you should just try to get all of the words that are said, including false starts and other disfluencies.
  10. Consider using transcription software such as Express Scribe, which can be downloaded for free. (Before trying it out, you should read the tutorial.) There are plenty of other options available.

Double-check that you have received informed consent for interview recording from your informant using the interview consent form.

Write Up

Write up the index for your interview. Be sure to indicate on the index which sections of the interview were transcribed. Type up the 1000-word transcription in clean form. Hutchins has a useful example of an index and transcription.

Final Due Date: 3/28 3/31

Back to top

Describe and Analyze Cultural Models

Goal

To find and document cultural models used in the construction of meaningful passages in your interview.

Directions

  1. Search:
    A. Look through your interview transcript for evidence of cultural models. It may be necessary to go back and listen to your whole interview again to find passages that contain clear cultural models. Choose a passage that makes it easy for you to find and document the cultural models involved.
    B. Consider each word in the transcript. Pay attention to detail. As you go along, make sketches, notes, rough drafts, of models. Try highlighting in different colors to represent emerging categories of events in the material.
  2. Analysis: Describe the cultural models that are required to make sense of, or establish the meaning of, the passage. Make sure that your description is accurate and clear. You might consider expressing it in a diagram or some other notation. Show how these models are used in the passage and how the passage relies on the listener having access to these models. Describe any inferences that the passage suggests. How is the listener expected to go beyond what is literally present in the passage?
    A. Choose to develop models that are well supported by the data. You will need to choose, and in order to choose intelligently you will have to do at least a partial analysis. This means that you will probably discard some part of the analysis you do. This is normal. It is the right thing to do.
    B. Describe the model. Use text for the full description. Be sure to include the parts of the model that are necessary to understand the material. As you develop the description of the model continually test it against the data. You may include other parts of the model too. If you do, try to indicate which parts of the model are essential to understand the data, and which are not.
    C. Represent the models as diagrams or in propositional form. This process will help you get the details of the models right, will help you see and understand the relations among models (hierarchical, sequential, competing, etc.), and will allow you to write the main description and analysis sections more concisely.
    D. Examine the role of the models in the organization of the material. This is the big question. Cultural Models organize meaningful discourse. Your job is to show which models organize the discourse you examined and show how those models were used by your informant (or author of other media) to construct the inscription you examined.
    E. Once you have identified some models, you can ask (and answer) these questions. Where does the model appear to be at work? What is it doing? How is it instantiated? (for example, informants often give a specific instantiation before a more general statement of the structure of the model). How is it related to other models? Here is where taking your time and attending to details pays off. Insight will be rewarded. You can discover something new while doing this. Even if it is only new to you, it’s important, and genuine discovery is a great feeling.
    F. Include the data! Attach segments of transcript or photocopy of other media. Be sure to make it easy for a reader to find the elements of the data to which you refer in the description and analysis.

You should have received informed consent prior to conducting the interview that you will analyze.

Write Up

700-1000 words of text, prepared for peer review. You can include additional figures and tables, as well as segments of the transcription that you relied on, and they will not count against your word count.

Draft due: 4/4

Peer Review Instructions

Answer the following questions:

  1. Does the text violate the terms of the IRB Protocol by describing a personal relationship or a private or illegal activity?
  2. Did they present evidence in the form of transcription from their interview?
  3. How well are the claims in the analysis supported by observations that appear in the transcript or description?
  4. How well can you understand the model that they describe? How could they explain it better? Did they use diagrams effectively? If not, should they have? Please elaborate.
  5. Does the text mention concepts from the readings or lectures? Does it use them well? Could other concepts help their analysis? Which ones?
  6. Overall, how would you rate this text?
  7. How else could they improve their paper?

Final Due Date: 4/11

Back to top

Video Documentation and Enhanced Transcription

Goal

The goal of this assignment is to learn how to attend to the cognitive details of the everyday world, and to document the visible aspects of cognition in the wild using video, as well as learning how to analyze video evidence to interpret the cognitive elements of environments and activities.

Directions

  1. Make observations: You have observed, photographed, and interviewed some participants at the field site. In this project you should conduct a more systematic study of the ways that people make meaning in everyday activity. Talk to the people and observe them in the activity. Take notes on their activities, describe their tasks, and videotape a person or, preferably, persons interacting with their environment or with one another. Collect at least 15 minutes of video, but not more than an hour total.
  2. Create an index and select clips for analysis: Using the method introduced in the interview project, create an index for your video. Select clips totaling at least 60 seconds duration for analysis.
  3. Transcribe clips: Make a detailed transcription of the activity in your selected clips. You should create an enhanced transcript that makes use of the visual elements of your video documentation. Refer to the examples borrowed from Edwin Hutchins’ course website: Example 1, Example 2.

Double-check that you have received informed consent for interview recording from your informant using the consent form.

In order to protect your subjects, do not store your video on your personal computer or laptop. You should upload the video to the secure UTD Box space. Any local copies created during transfer or analysis should be deleted immediately afterwards. 

Write Up

Turn in your enhanced transcript.

Draft due: 4/18

Peer Review Instructions

Remember that transcriptions are meant to be literal portrayals of what is in the data, and that actual speech is full of disfluencies, ungrammatical utterances, and so on. Focus your feedback on what elements of the formatting or use of visual images you find confusing and hard to follow.

Final Due Date: 4/25

Back to top

Multi-modal Cognitive-Ethnographic Analysis

Goals

The goal of this activity is to use all of the data you have collected so far, in terms of observations, field notes, photo documentation, interviews, and especially video recordings, to produce a cognitive ethnographic analysis of (one of) the main activity (or activities) at your field site.

Directions

  1. Analysis: Analyze your corpus of data using the concepts presented in the lectures and readings, focused on answering the questions, (1) “What is ‘cognitive’ about this activity?” and (2) “How does the cognitive process work?”
  2. Write up the analysis. Be sure your analysis makes use of the concepts in the readings, as well as the guidance presented in the previous assignments on how to analyze data.
  3. Include representations of your data, descriptions of the data, and figures, diagrams, or tables that help with your analysis.

Double-check that you have received informed consent for video taping the participants.

Write Up

1500-2000 words of text, prepared for peer review. As with previous assignments, your write-up should clearly distinguish between description and analysis, and your analysis should be focused on providing a cognitive interpretation of the data described in your description section. Data, figures, references, etc. will not count against your word count.

Draft due: 4/26 4/29

Peer Review Instructions

Keep in mind the questions we have been asking all semester, and provide thoroughly detailed feedback that will help your peer write an excellent final draft.

Final Due Date: 5/8 5/10

Back to top

Acknowledgements

Credit to Edwin Hutchins and Melanie McComsey from whom I’ve adapted these project ideas and taken some of the text for the directions.