The narrative arc: Revealing core narrative structures through text analysis | Boyd, Blackburn, Pennebaker; Science Advances 2020; 6

RQ: "Is it possible to use text analytic methods to capture markers of staging, plot progression, and cognitive tension?" (2)

The focus is really on "finding objective and quantifiable markers of narrative structure" (1).

"The primary purpose of the current research was to determine if it is possible to quantify the three narrative processes by relying on the analysis of function and cognitive process words across different types of narratives." (2)

General consensus of theoretical frameworks is that a narrative structure is independent from the content of stories. The authors of this paper take this assumption and employs it to hypothesize about what quantifiable "markers" may then indicate narrative structures.

Note that this concerns "standard, normative structures" (3).

Namely, this would suggest that indications of narrative structure are largely independent of content words ("content words include nouns, regular verbs, and most adjectives and adverbs" (1)), and should be better indicated by function words.

"function words are typically short connector words such as pronouns, prepositions, articles, conjunctions, negations, auxiliary verbs, and non-referential adverbs (e.g. "so" and "really")" (1-2)

Apparently, "Psychometrically, prepositions and articles behave differently from other function words" (2)

Very interesting for my own current research idea ("can we explain the continental-analytical divide in philosophy in terms of style ?") the following passages were extra interesting:

Inspections of essays that were high in articles/prepositions found that they were analytical, formal, and hierarchically structured in terms of how information was presented. Those essays that scored high in pronouns, auxiliary verbs, and so on were found to be far more character and action oriented, as well as more informal. (2)

The authors then make some predictions about the relations between function words and the progression in a narrative structure (see p.2). In particular, for the relation between staging, plot progression, and cognitive tension. Staging and plot progression is mainly framed in terms of function words, whereas cognitive tension is measured by "cognitive processing words (e.g. "think," "believe," "understand," and "cause")" (2) that indicate sense-making.

In other words, this approach of this research is "aligning language features with narrative theory" (2)

Method

"Given that no previous scholars have successfully identified linguistic patterns that indicate a normative narrative structure, we sought to analyze a reasonably large sample of stories using a relatively conservative word count strategy." (3)

Q: Why "conservative"?

As hypothesized, different function words were associated with different narrative markers and thus are analyzed in separate groups:

Function word rates associated with staging (articles and prepositions) were calculated separately from those associated with plot progression (pronouns, auxiliary verbs, negations, conjunctions, and nonreferential adverbs). (3)

Of course, each text contains both types, so it's more about the proportion of one type of the other. So they compute rates or proportion on the total words of a text.

They made a "narrative process dictionary" where they associated marker functions words per stage in the narrative progression:

The total number of words, word stems, and lemmatized words varied considerably across the three dictionaries: staging, 75 words; plot progression, 448 words; and cognitive tension, 393 words. (3)

Texts were "split into five equal-sized segments" (3)

Because baseline rates differ within genre, they controlled for this:

Base rates of the three dictionaries varied considerably by genre; all scores were standardized within each text separately for each narrative dimension to focus on the relative, story-internal shape of each narrative dimension across texts. (3)

Main findings

RQ1:

  • "Consistent with predictions, the use of staging- related words is highest at the beginning of the story and drops shortly thereafter as the story unfolds." (4)
  • "As can be seen in the middle panel, words associated with plot progression were lowest in the beginning parts of the texts and sharply increased thereafter." (4)
  • "As predicted, the cognitive process words were used most midway in the narrative." (4)
  • So "The importance of the first research question was to demonstrate that the theorized processes existed, were consistent with the Freytag hypotheses, and were reasonably consistent across three types of stories" (5)
  • No significant differences between traditional corpora (published novels, short stories, TAT stories from the internet)
  • Narrative structure representations are shown to be non-linear for each analysis; the non-linear shapes were consistent across corpora.

RQ2:

  • "The results of all RQ2 analyses found no evidence that people’s ratings of narrative quality or popularity were related to narrative structure." (6)
    • So that's on two extra corpora, one with romantic novels, one with movie dialogues (but had subjective ratings available)

RQ3:

  • "The three corpora reveal relatively similar patterns to the original story corpora for both staging and plot progression." (7)
  • "The cognitive tension dimension revealed the most notable con trast between the nonfiction texts and the traditional stories." (7)