ChatGPT Is Not Your Friend

Mark C. Marino

Reading with Claude

Until now, these activities have primarily revolved around writing or generating text. In my Advanced Writing course, I asked my students to explore the usefulness of LLMs to augment their reading. Using their choice of LLM, though primarily Claude.ai or Chatpdf, students examined scholarly articles. Our question: could the LLM help us get more content out of an essay than we could get just by reading it alone. Writing essays on this question, most students took the stance that reading was far superior to reading with an LLM. However, their arguments basically came down to comparing an article to its summary. In later experiments, we found quite positive results.

While these LLMs could not help a student access the same level of content they could access merely by reading, they could use their special ability of abstraction to serve as tools of what we might call distant reading (Moretti 2013). Uploading one or more papers of a particular genre, students could then ask about generic features, such as typical sentence style or length, frequency of source citation in various sections of the paper, or even the diction of the paper. While LLMs are not specifically designed for genre analysis, they are, in effect, genre learning machines. As students move through writing activities, learning a new genre is often their first challenge. Whether or not the LLM could abstract out the conventions of the genre accurately, asking the students to use the LLM in this way helped focus their attention to the nature of genre.