Abstract
How do online daters come to understand and make sense of their online dating experiences and the algorithms that underlie online dating platforms? Across two mixed-method studies, we take a metaphoric approach to identify and explore people’s folk theories about traditional dating, online dating, and online dating algorithms. In Study 1, we take a quantitative approach and use an innovative wiki-survey procedure to identify individuals’ folk theories of online dating and their associated themes through content analyses. In Study 2, we take a qualitative approach, exploring participants’ folk theories through in-depth interviews, extended case method, and grounded theory. Our studies uncovered two folk theories unique to traditional dating (
The Internet has transformed how many people find romantic relationships. Over a third of Americans have used an online dating service and a quarter of Americans have met up in person with someone they met through online dating (Anderson et al., 2020). In line with this rise in online dating, daters have had to adjust their expectations and methods for courting romantic partners from the traditional dating context to the online dating context, adapting to the new affordances, constraints, and features that are uniquely present in online dating platforms.
As with traditional dating, hopeful online daters are concerned with finding a compatible partner—someone who matches their ideals, interests, and relationship goals. To this end, online dating services often distinguish themselves by their asserted ability to provide users with especially compatible matches. By using hidden algorithms that accommodate factors including but not limited to the user’s preferences in a partner (e.g., does not smoke), type of romantic relationship the user is looking for (e.g., short-term, long-term), and the user’s activities on the service (e.g., like-to-dislike ratio), online dating services curate recommended potential partners. These algorithms are often marketed to users by their “scientifically backed” ability in determining compatibility scores, however the exact inputs and methods that the algorithms use to calculate these scores remain proprietary (Sharabi, 2021). Users may be aware that these hidden algorithms exist but may have little insight into how their own information and actions on the online dating platform influence the output of these algorithms’ recommendations for matches.
Given the hidden and complex nature of the algorithms that underlie online dating services, how do individuals come to understand and make sense of the full online dating process, from profile creation to partner selection? How do their conceptualizations of this process—their folk theories of online dating—influence how they use online dating services to form romantic relationships?
Folk Theories
Folk theories, also known as naïve theories or lay theories, are people’s intuitive explanations for why a phenomenon, such as an event, a behavior, or a social process, has occurred. People may hold folk theories about social processes such as the mental states of others (Malle, 1999), as well as physical and structural systems (Gelman & Legare, 2011). People often rely on their folk theories to understand and make inferences about their social worlds, which then can shape their subsequent behaviors in the relevant domain (Hong et al., 2001). For example, a child who observes that pressing a button on a remote turns on the television may develop the folk theory that the remote controls the TV. She may then act on this folk theory by pressing buttons on the remote until the TV turns on. Despite not knowing the full mechanistic details behind how TV remotes work (transmitting signals of infrared light to the TV receiver), her awareness of and experiences with the system led her to develop a working folk theory that helped her accomplish her goal of turning on the TV (Bucher, 2017; DeVito, 2021). Due to their role as a meaning system and guiding framework for interpretation and prediction, once developed folk theories are generally held stable and maintained across time, although folk theories can be updated with new information or experiences (DeVito et al., 2018).
Folk Theories of Cyber-Social Systems
More recently, the framework of folk theories has been applied to the study of cyber-social systems, broadly defined as “digital technologies that facilitate, enhance, and scale human endeavors” (French & Hancock, 2017). Within this digital context, researchers have argued that folk theories inform not only how people learn about complex media systems and algorithms (through their own experiences, knowledge of the platforms, information from others, etc.; Bucher, 2017), but also how they think about, behave on, and react to such systems (DeVito, 2021). Research on folk theories of cyber-social systems so far has mainly focused on identifying the various folk theories that people hold about social media platforms such as Facebook, Twitter, and Instagram (DeVito et al., 2018; French & Hancock, 2017). For example, some users believe that the Facebook Newsfeed acts as a rational assistant that understands and caters to their social media interests, while other users believe that the Facebook Newsfeed acts as an unwanted observer, using their personal data for corporate gain (French & Hancock, 2017).
Further research has investigated how the folk theories people hold can guide their behaviors on and thoughts about various social media platforms. For example, users who hold the folk theory that personal engagement (e.g., liking and commenting on posts) increases the visibility of certain types of posts on their Facebook Newsfeed may be more likely to interact with some posts than others (Eslami et al., 2016). When the underlying algorithms change however, users can experience expectation violation and frustration as their working folk theories become nonfunctional, reacting in particular to the parts of the system that no longer correspond to their own individual folk theories (DeVito et al., 2018). Consequently, the folk theories that people hold about a cyber-social system not only inform their beliefs about how the system works, but also shape how they use the system to accomplish goals and how they respond when the system changes and their actions no longer result in the expected outcomes.
Folk Theories of Online Dating
Like social media platforms, online dating platforms can be classified as a type of cyber-social system. Initial work investigating people’s conceptualizations of online dating described a marketplace metaphor, termed “relationshopping,” which can be thought of as a folk theory of online dating (Heino et al., 2010). These folk theories can have important consequences. For example, with the increase in “supply” of potential partners available through online dating, participants who subscribed to a “relationshopping” folk theory used decision-making strategies that differed from traditional dating strategies. One such strategy was “filtering,” in which participants “shopped” for partners by using the search or filter functions of online dating websites, narrowing down the number of partners to those that fit their idiosyncratic criteria. These data suggest that folk theories of online dating can impact dating strategies and behaviors when seeking a romantic partner.
More recently, Sharabi (2021) examined how beliefs about the effectiveness of online dating algorithms influenced perceptions of a first date. Participants who believed that the algorithms were effective in providing compatible matches engaged in more pro-relationship communication behaviors and were more likely to report greater first date success, suggesting that people’s
From this prior research, three interesting research questions arise: First, while previous research on folk theories of cyber-social systems has focused mainly on people’s conceptualizations of the algorithms behind these systems, prior work examining online dating folk theories (Heino et al., 2010) suggests daters are focused less on the algorithms underlying the online dating systems and more on online dating as a social process. That is, online dating requires users to create profiles, make mate-selection decisions, exchange messages, and eventually go on in-person dates. As many online dating platforms guide users through this same progression of stages in the online dating process (see Markowitz et al., 2019), online dating entails the activation of many psychological and relational processes throughout the initial acquaintanceship stages. Thus, it is likely that people’s conceptualizations of online dating may center on these processes, as opposed to the specific cyber-social system being used. This leads to our first research question:
Second, while people’s conceptualizations of online dating appear to be more focused on the social process rather than the underlying algorithms, what (if any) conceptualizations of the algorithms do people have? Online dating services often advertise their algorithm’s (supposed) ability to match online daters with compatible others (Finkel et al., 2012). However, the exact factors used to determine compatibility are often treated as corporate secrets, leaving substantial ambiguity about how the algorithms work. Indeed, people may not even be aware that an algorithm is being used to curate matches (Hamilton et al., 2014). For those who are aware, their beliefs about the algorithms may shape their subsequent online dating behaviors and outcomes (Sharabi, 2021). This leads to our second research question:
Finally, how do online dating folk theories compare with folk theories of “traditional” in-person dating? We use Finkel et al.’s (2012) definition of conventional offline dating to define
Uncovering whether people hold fundamentally different ideas about the online (vs. traditional) dating process is important given the mixed opinions that people hold about the impacts of online dating on the broader dating environment. Despite its growing ubiquity, many people still believe that online dating has made it more difficult to form meaningful connections and that traditional dating is inherently better and more personal compared to online dating (Anderson et al., 2020). Existing popular stereotypes continue to frame online daters as individuals who are only searching for casual sex, unable to form meaningful connections or lasting relationships—however, it is unknown whether this is actually the case. If online daters hold similar folk theories for dating in both online and traditional contexts, this could suggest that they treat both forms of dating the same way psychologically and engage in similar relationship initiation strategies regardless of the context. However, if daters hold distinct folk theories for each context, this could suggest that relationship initiation strategies may be context-dependent. Alternatively, given that traditional and online dating processes can be thought to converge after the first in-person date, folk theories of traditional and online dating may be similar or different depending on the stage of relationship initiation that daters choose to focus on. This would suggest that folk theories (and relationship initiation strategies) are context-dependent only during the very beginning stages of relationship initiation, before partners meet for a first date. This leads to our third research question:
We investigate these research questions across two mixed-method studies, beginning with a survey in Study 1 to identify the many different folk theories people hold about online dating. We then move to interviews in Study 2 to explore further people’s folk theories of online dating as a social process, their beliefs about online dating algorithms, and similarities and differences between their folk theories of traditional and online dating. This mixed-methods approach allowed us to not only capture a broad range of folk theories on online dating, but also allowed us to understand in-depth how people make sense of, feel about, and react to the folk theories that they hold. Following previous research on folk theories of relationship development (Baxter, 1992) and cyber-social systems (Eslami et al., 2016; French & Hancock, 2017), we used a
Study 1
In Study 1, we were interested in collecting a broad range of metaphors to discern daters’ perspectives on online dating and to extract the key folk theories underlying these metaphors. We recruited participants and had them complete a novel crowdsourcing wiki-survey task to elucidate all possible metaphors of online dating. The first and second authors then used grounded theory (Charmaz, 2006) to develop a coding scheme and coded the metaphors. We then performed content analysis (Neuendorf & Kumar, 2016) to identify key themes within the metaphors.
Method
Participants
Participants (
Procedure
All Our Ideas Wiki-Survey
Participants completed a collaborative voting task modeled after Study 1 from French and Hancock (2017). Participants visited a wiki-survey website (All Our Ideas, http://www.allourideas.org, Salganik & Levy, 2015) where they were presented with a pair of metaphors. They were instructed to “vote for the metaphors which you think best represent your beliefs of online dating.” In the wiki-survey, participants were presented with two metaphor options at a time and had various responses to choose from; they could either (1) vote for one of the two options, (2) indicate that they cannot decide between the two, or (3) submit their own metaphor in a separate field. Each option included the metaphor and a one-sentence summary explanation (see Table 1). The two metaphors presented in each voting round were randomly chosen by the All Our Ideas platform from a master list, which was initially seeded with 18 metaphors developed by a team of five research assistants who had firsthand experience and knowledge of online and mobile dating (see Supplemental Material). If participants submitted an original metaphor rather than cast a vote for the existing options, their metaphors were added to the database and presented to future participants to vote in subsequent rounds of voting. Participants were asked to vote at least 10 times but could vote as many times as they wished.
Top 10 Metaphors from All Our Ideas Wiki-Survey.
Due to the large volume of metaphors submitted and voted on, the following decision rules were developed to determine the final list of metaphors: (1) metaphors must have a win-to-lose ratio greater than 1 (i.e., must have more winning votes compared to losing votes; calculated as number of wins divided by number of losses), (2) metaphors must have a winning rate greater than 50% (calculated as number of wins divided by total number of overall votes), and (3) metaphors must have a number of total votes that is comparable to the rest of the metaphors in the sample (e.g., a metaphor that only received 50 votes when all other metaphors received 800 or more votes would be dropped from consideration). 1
Content Analysis
Once the final list of winning metaphors was compiled, the first author used grounded theory (Charmaz, 2006) to inductively identify themes within the metaphors and then discussed these themes with the second author. Once the first and second authors agreed on coding schemes for the metaphors, all authors then individually coded the metaphors from the final list. Interrater reliability was acceptable (Krippendorff’s α = .67); we proceed with exploratory interpretations. 2
Results and Discussion
All Our Ideas Wiki-Survey
The wiki-survey task resulted in a total of 49 winning metaphors. The top 10 metaphors, in terms of winning rate, were “a roller coaster,” “hide and seek,” “a hookup app,” “casually browsing,” “a radio,” “an audition,” “bingo,” “a game of darts,” “a farmer’s market,” and “a flea market” (see Table 1 for descriptions of the top 10 metaphors and the Supplemental Material for the full list). Nine of the top 10 metaphors and 35 of the 49 total metaphors were user-submitted, supporting the theoretical value of crowdsourcing and participatory research (French & Hancock, 2017).
Within the top 10 metaphors, some key themes emerged. A few of these metaphors discussed online dating as a social process (e.g., “Hide and seek: you never know who you’ll find until you properly search.”), addressing RQ1. Some metaphors hinted at elements of randomness and luck inherent in online dating (e.g., “Bingo: When a random, magical and lucky combination aligns you win your soulmate”) and this was apparent in metaphors that likened online dating to browsing an open marketplace as well (e.g., “A farmer’s market: a gathering of people from all walks of life, looking to relax, enjoy themselves & perhaps find something good”). Only one metaphor in the top 10 directly addressed the platform’s algorithmic influence on the online dating process (“A hookup app: seeks physical compatibility between two people”). These results suggest that people can and do form folk theories of online dating and that these theories focus on the social process more than the algorithms underlying the platforms. It may also be possible for people to hold multiple folk theories at once (i.e., folk theories are not necessarily exclusive of each other; an individual could believe that online dating is both like “hide and seek” and “an audition”).
Content Analysis
From the content analysis, we identified six themes (Table 2). Like the findings for the top 10 metaphors, a majority of the themes that emerged focused on the social process of online dating rather than the algorithms that underlie the platforms. Elements of effort and luck (e.g.,
Study 1: Metaphor Themes, Definitions, and Examples.
Why were participants’ metaphors generally more focused on the social process relative to the algorithms involved in online dating? One possible reason is that participants may believe that the algorithms perform no better than luck or chance (as the above metaphors suggest) and therefore focus instead on the aspects of online dating that they have control over. Alternatively, participants may be unaware of the algorithms or the extent to which these algorithms influence their online dating experiences (Hamilton et al., 2014; Tong et al., 2016) and have not incorporated the algorithms or platform features into their folk theories.
Study 2
Study 1 addressed our first two research questions about what folk theories people held about online dating as a social process and about online dating algorithms using crowdsourcing and quantitative methods. While we asked participants about online dating specifically, many of the metaphors could arguably describe traditional dating as well. For example, the metaphor “Hunting: searching for and pursuing someone of romantic interest” could be as easily applied to traditional dating as to online dating (and in fact has been elicited in past research on metaphors of traditional dating; Aksan & Aksan, 2010). Thus, a remaining question is: What are current-day folk theories of traditional dating and how do they compare to folk theories of online dating?
In Study 2, we conducted interviews with online daters to examine how people conceptualize dating in the modern era and the role that online dating plays in shaping their experiences and outcomes. The interviews allowed us to capture not just
Method
Participants
Participants (
Procedure
Participants were interviewed individually by the first author or a research assistant. Interviews lasted 40 minutes on average and followed a protocol developed using findings from Study 1 (see Supplemental Material). The protocol provided a semi-structured guide for the interview that allowed the interviewer to probe further at topics salient to the discussion at hand. The interview contained four parts: (1) traditional dating, (2) online dating, (3) online dating algorithms, and (4) comparisons between traditional and online dating. In parts 1 and 2, participants were asked to define what traditional/online dating meant to them, describe the process of traditional/online dating (from first meeting to forming a relationship), and share their opinions on traditional/online dating. Participants then were asked to come up with and elaborate on a metaphor for traditional/online dating. For part 3, participants were asked to think about online dating platforms that they have used in the past and discuss how those online dating platforms affected their dating experiences, whether they were aware of algorithms being used to curate the profiles they viewed, what inputs they thought the algorithms might take into consideration, and how effective they thought the algorithms were in providing compatible matches. Following parts 1 and 2, they then came up with and elaborated on a metaphor for the algorithms. Finally, participants were asked to compare traditional dating to online dating. At the end of the interview, participants answered demographic questions and were debriefed.
Data Analysis
Interviews were digitally recorded and then transcribed by undergraduate research assistants. The data were analyzed using both extended case method (Burawoy, 1998) and grounded theory (Charmaz, 2006) approaches to understand how participants’ individual experiences shaped their folk theories and the general themes that arose across interviews. Per extended case theory, we began our analyses by using the findings from Study 1 as an initial guiding framework. When we came across observations that were insufficiently explained by this initial framework, we then took an inductive, grounded theory approach to further identify common themes and patterns across the interviews. To conduct the analyses, the first author read through each interview transcript and identified common themes that appeared within the data. The second and third authors then examined the data and recommended suggestions for adjusting and fine-tuning the themes until a consensus was reached. The combination of these two approaches and the iterative discussions resulted in a more complete understanding of participants’ perceptions of traditional dating, online dating as a social process, online dating algorithms, and their relevant folk theories.
Results and Discussion
From the interviews, it was clear that participants held strong opinions about both traditional and online dating. Several themes emerged for both, while some unique aspects were identified for each context.
Converging Folk Theories for Traditional Dating and Online Dating
Across the interviews, two folk theories emerged for both traditional and online dating: (1)
For traditional dating,
The second folk theory that emerged from the interviews for both traditional and online dating was It’s kind of passive. Just going about your own life and path, can’t really do anything about it. . . . It’s kind of out of your control. Feels a lot more based on circumstance.
Participants who had graduated from college and joined the workforce rarely met new people outside of their established social groups and found it difficult to seek out potential partners. To these participants, traditional dating was a black-box process that happened only when circumstances unexpectedly facilitated it; any active efforts on their own parts were viewed as futile.
The theme of When people say it’s a numbers game in terms of probability, it makes it harder to meet someone you would be in a successful long-term relationship with, because you might miss out on them in the sea of everyone else on the app. On the other hand, it does expand your network and gets you outside your comfort zone a little bit just to meet new people and more people which is very helpful for me.
This ability to meet many potential partners outside of one’s own network was viewed as a major boon; however, the large number of people on the online dating site could become overwhelming (Tong et al., 2016), and the fear of missing out on “the one” due to having to browse through so many profiles was common. One participant described this experience as “trying to find a needle in a haystack” (P11).
Folk Theories Unique to Traditional or Online Dating as a Social Process
In addition to the two shared folk theories, we identified two folk theories unique to traditional dating and one unique to online dating. The presence of these folk theories suggests that although there is some overlap between people’s conceptualizations of traditional and online dating, there are also some core distinctions.
Traditional Dating
Several participants proposed the folk theory of
The second unique folk theory that emerged for traditional dating was
Online Dating
The unique folk theory that emerged for online dating was On websites like Hinge, their bios are more of snippets, not even full sentences, so I think it’s about how you catch someone’s attention and that’s a game in and out of itself. And I think the swiping action is also something people like because it’s fun and makes it feel more like a phone game you play. (P09)
Folk Theories for Online Dating Algorithms
While participants had little trouble coming up with metaphors for traditional dating and online dating as a social process, most participants struggled to come up with a metaphor for online dating
The first,
The second folk theory, It seems that someone is there at every step of the process and pushing you along or having control over the decisions you are able to make, because they have control over the possible decisions you can choose from. So it definitely feels like there is someone behind the scenes controlling it all.
The final folk theory for online dating algorithms was that of a
Despite holding these various folk theories about how online dating algorithms work, participants had mixed feelings about having an algorithm govern their dating lives. Some participants questioned the effectiveness of algorithms in determining compatibility and filtering out less compatible matches (“If it was really super effective, I would have a higher percentage of wanting to swipe right more than just 1 in 15”; P03). A few also commented that having an algorithm define compatibility and attractiveness felt unnatural (“should a computer really decide for me what I like and don’t like?”; P03) and could potentially perpetuate harmful biases by “catering towards certain negative stereotypes” (P07). Other participants were more ambivalent about algorithmic influences in online dating platforms (“algorithms underlie every other app that I use on my phone so I don’t have a problem with it being on an online dating app either”; P11), explaining that “since we have that big data out there, we might as well use it to make things go more smoothly” (P05). One participant commented, “If [the algorithms] can tell what I like better than I can, then more power [to them]” (P04).
General Discussion
Across two mixed-method studies, we identified and examined the various folk theories that people hold about traditional dating, online dating, and online dating algorithms. Our findings provide insights into how daters make sense of traditional and online relationship development processes as well as the algorithms that underlie online dating platforms. Study 1 took a quantitative approach, crowdsourcing metaphors to identify folk theories of online dating and their underlying themes. Study 2 took an in-depth, qualitative approach, probing deeper into the folk theories that daters hold to understand how each one operates and how daters make sense of their dating experiences. Through our interviews, we identified one folk theory unique to online dating (
Our first research question asked what folk theories people hold about online dating as a social process. Our results from Studies 1 and 2 suggest that there are multiple folk theories for online dating. When prompted to come up with a metaphor, almost all participants focused on online dating as a social process, drawing upon their prior experiences and knowledge of online dating to formulate their metaphors. Participants in Study 2 uniquely described the online dating process as a
Results from Study 2 suggest that some of the folk theories people hold overlap both online (RQ1) and traditional dating (RQ3). Our data support prior research on the marketplace metaphor (Ahuvia & Adelman, 1993) and its extensions from traditional to online contexts (Heino et al., 2010). Importantly, we find that different aspects of the
The themes of
Our second research question asked what folk theories people hold about the algorithms underlying online dating systems. The three folk theories we uncovered in Study 2—
Our final research question asked how people’s folk theories of traditional dating compared to their folk theories of online dating. In addition to the two overlapping folk theories, we found two folk theories unique to traditional dating.
The
A major contribution of this study is uncovering the need to delineate folk theories of
Finally, the various folk theories people held for traditional and online dating also focused on different stages of a relationship’s trajectory (e.g.,
We conclude by noting some limitations of the present research. For Study 1, we primarily recruited participants through Amazon’s Mechanical Turk, leading to a potentially more diverse (compared to an undergraduate population) but also potentially more inattentive and dishonest sample (Buhrmester et al., 2018). Also, while we were able to glean novel insights from participant-submitted metaphors on the collaborative wiki-survey platform (compared to the more typical format of closed survey questions with researcher-defined constraints; Salganik & Levy, 2015), the nature of the wiki-survey meant that latter participants had more options to choose from compared to previous ones (due to submissions of metaphors from earlier participants) and this could have influenced voting behaviors.
A limitation of Study 2 was the college-aged range of our sample. While we were able to reach saturation within our sample, a more varied sample comprised younger and older daters may reveal a greater range of folk theories. Adolescents who spend a significant amount of time online (Orben & Przybylski, 2019) may be more accustomed to the idea of meeting partners online and may be more aware of algorithmic influences within dating platforms. Older generations may hold different folk theories of traditional dating and their limited use of technology (including dating platforms; Renaud & Van Biljon, 2008) may make them less aware of algorithmic influences. These factors could result in different folk theories for traditional and online dating processes and algorithms.
Finally, we note that while the use of metaphors provides an intuitive and accessible method of tapping into participants’ folk theories (Eslami et al., 2016; French & Hancock, 2017; Lakoff & Johnson, 1980), metaphors can introduce a level of complexity for identifying shared meanings and conceptions as they are indirect, culturally specific, and potentially ambiguous. Future research should consider using additional methods that do not rely on metaphors (such as concept mapping) to study folk theories. Future research should also investigate how people’s motivations for traditional or online dating may shape the folk theories they hold, and how folk theories of relationship development and of online dating algorithms affect relationship initiation strategies, behaviors, and outcomes.
Supplemental Material
sj-docx-1-sms-10.1177_20563051221089561 – Supplemental material for Folk Theories of Online Dating: Exploring People’s Beliefs About the Online Dating Process and Online Dating Algorithms
Supplemental material, sj-docx-1-sms-10.1177_20563051221089561 for Folk Theories of Online Dating: Exploring People’s Beliefs About the Online Dating Process and Online Dating Algorithms by Sabrina Angela Huang, Jeffrey Hancock and Stephanie Tom Tong in Social Media + Society
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by a NSF Grant (#1520723) awarded to the second and third authors
Supplemental Material
Supplemental material for this article is available online.
Notes
Author Biographies
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
