There is a principle in emergency medical care referred to as the prudent layperson standard (Langford etal., Reference Langford, Bearie, Kazzi, Blasko and Kohl2003), which is used to determine whether a condition meets the threshold for a medical emergency. Amedical emergency is one of sudden onset and severity such that a prudent layperson, possessing an average knowledge of health and medicine, believes that urgent and unscheduled care is required. This language was adopted into federal law as a response to denials of coverage by insurance providers who based decisions on the final diagnosis rather than the presenting symptoms despite the fact that 90% of urgent and nonurgent symptoms overlap (Li etal., Reference Li, Galvin and Johnson2002). The prudent layperson standard communicates the idea that it is reasonable to expect that failing to seek help during times of severity and uncertainty would jeopardize one’s functioning and the exercise of judiciousness should be extolled. The examples that White etal. (Reference White, Ravid, Siderits and Behrend2022) note on the ways industrial-organizational (I-O) psychology responded to businesses and uncertainty in the midst of the COVID-19 crisis emulate those of an emergency physician providing services to a patient. Indeed, the emergence of COVID-19 was sudden and severe. Its effects damaged the economy and the workplace; thus, an urgent response was required. To prepare for the next crisis, White etal. (Reference White, Ravid, Siderits and Behrend2022) state that it is our duty to produce timelier technology research and encourage us to “choose action over cautiousness.” Although we agree with their call, we would further add to their encouragement “and be sensible in your choice to act.” We argue that there will always be a lag between technologies and their first empirical examinations for several reasons.
First, computing power doubles roughly every 2 years (Moore, Reference Moore1965), yet our resources for conducting research do not. This constant doubling of computing power spurred the information era, and the trend persists as we continue to see record investments in technology (Rosenbaum, Reference Rosenbaum2019). More computing power means even more technologies and applications are being developed and released at alarming rates. To grant perspective, there were over 100,000 apps released on the Apple App Store and Google Play in February 2022 alone (Ceci, Reference Ceci2022). Given the rapid release of technology applications and the amount of research funding dedicated to computing, it can be surmised that the time delay from technological milestone to research will only exacerbate.
Second, time is necessary for technology to diffuse (Rogers, Reference Rogers1962). The population of early adopters of a technological innovation at release is typically small, making it a challenge to collect an adequate representative sample proximal to the innovation launch. Consider that Skype was released in 2003, but user time spent on web conferencing apps reached a mere 10% in 2018 (Apsey, Reference Apsey2020). Due to factors like cost, access, familiarity, and need affecting adoption, time delays will persist in technology research.
Third, planned obsolescence, the practice of creating a new product with an expiration date at its conception (Malinauskaite & Erdem, Reference Malinauskaite and Erdem2021), makes studying some technologies a gamble. When designing a study, a researcher needs to consider how this practice can affect the technology under investigation. Technologies are regularly updated, in some cases requiring their users to monetarily maintain these updates (e.g., software updates). These practices can affect studies that use these technologies in small ways like sample undercoverage, where only affluent or enthusiasts for that technology are available or in large ways where the technology is obsolete when an investigation reaches publication.
Rather than lament these woes and abandon the pursuit of conducting timely technology research, we urge our field to apply a prudent researcher standard in choosing what to study given our limited resources. As White etal. (Reference White, Ravid, Siderits and Behrend2022) note, research programs are limited in terms of funding and time available to conduct research. As researchers, we endeavor to answer the questions that would have the greatest influence with these finite resources and must justify the risk of devoting resources to one study versus others. This balancing act requires adopting frameworks for evaluating risks relative to the value of pursuing one investigation over others. To assist with this endeavor of producing timelier technology research, we offer considerations on available resources, a discussion of the action priority matrix (APM) as a framework for assessing research opportunities, and examples of how researchers can choose action over caution. By using a prudent researcher standard, we can execute on White etal.’s recommendations of action, exploration, collaboration, dissemination, and creation, despite the resource limitations we face.
A prudent researcher standard
Applying the prudent layperson standard to technology research, we argue the prudent researcher is one who possesses average technological knowledge and believes that researching the effects of a new innovation will yield valuable information. This could present as observing early warning signs of the harm caused by new technology or as predicting the potential benefits for societal advancement. In either case, White etal.’s (Reference White, Ravid, Siderits and Behrend2022) suggestion of choosing action over cautiousness means making trade-offs to determine which research investigation would have the greatest contribution. We borrow from Hoole and Martineau’s (Reference Hoole, Martineau and Day2014) definition of impact as any near- or long-term change at the individual, group, organizational, or societal level. It could be inferred, then, that the greater a change at any level results in greater influence or effectiveness. Applying a prudent researcher standard means answering several questions to assess the potential outcomes that would result from an investigation, such as at which level of analysis should research questions be directed, how quickly can data be collected, and to what extent results can generalize.
Technology companies have adopted a prudent standard as evidenced by how they prioritize initiatives to maximize value creation for their products. These companies too must judiciously weigh risk relative to value. Several have adopted frameworks like the Agile Manifesto, Kanban, and Scrum to help make these decisions. The APM is a practical framework that researchers can use to determine which opportunities to pursue. As shown in Figure 1, an APM consists of two axes: effort and impact. Each research opportunity under consideration is assessed along those axes as either high or low. Focusing on the discussion of timelier technology research, we view effort as the amount of energy and resources available to pursue a research investigation. Specifically, how easily can resources like people for staffing or funding be organized and secured? How much time can be devoted to answering the research question? How easily or well connected is the researcher to the technology under investigation? We view impact as the number of people, groups, organizations, or societies that research would likely affect and the number of stakeholders that would be affected by the outcomes of a research opportunity as a valuable metric.
Action Priority Matrix.

The APM framework results in a 2 x 2 matrix for the investigations being considered. Opportunities that are low-effort and high-impact are the quick wins. Pursuing these activities would lead to timelier research as they have been identified to be the least costly in terms of resources. White etal. (Reference White, Ravid, Siderits and Behrend2022) suggested forming additional partnerships. We believe these activities would fall in this quadrant. Some additional partnerships to consider include forming alliances, think tanks, and incubators with organizations and researchers, especially in the technology space. Other collaborations could also include hosting themed cross-disciplinary events and competitions with research and learning at their core. We also recommend that organizations sponsor cross-functional projects for teams to conduct technology-oriented investigations. Beyond collaborations, it is necessary to note that research can be hindered not only by access to technology but also by the cognitive load needed for learning how to use it. Regularly updated resources, online tutorials, and databases of existing documentation provide a way for researchers to familiarize themselves and reduce the knowledge and skill gaps researchers would have to overcome with effort to use and research technology.
The quadrant formed by high-effort and high-impact activities are considered major projects. Investigations in this space can be made timelier by reducing resource needs or increasing resource access. Creation and dissemination activities might find themselves in this space. One method rooted in creation is for universities to offer freely available foundational courses in technology, psychology, business, and research. White etal. (Reference White, Ravid, Siderits and Behrend2022) encourage I-O psychologists to disseminate through attending more technology-based conferences. We extend that suggestion to cross-disciplinary conferences to meaningfully learn from other fields. Additionally, we encourage conferences to be more student accessible and urge research faculty to encourage student participation. Resource needs can be reduced by making certain resources more readily available. For example, blocking access to articles behind a paywall is an obstacle to conducting research. Therefore, it could be beneficial to publish on open access channels.
Low-effort and low-impact activities are the fill-ins. These are the activities pursued between quick wins and major projects, and they can be focused on very specific pursuits. For example, the adoption of new software that changes a workplace procedure may increase productivity in a specific department but needs investigation. In this case, the organization can perform case studies to see its effects within the department at minimal cost, but such research would not often be applicable beyond the organization, or even beyond the department. Another example could be the development of a new questionnaire for internal use in an organization to measure organizational attitudes toward changes in technology used. The cost to produce said questionnaire is low, but its influence would likely be limited to those in the organization, particularly those who will use the new technology. For investigations that fall in this space, we recommend ideating around expanding the research design to increase the potential value. To do this, emphasis has to be put on increasing the scope of investigations. Collaborations across departments, branches, or organizations can increase the utility of research. If collaboration is not possible, making findings or methodology from internal research open access in the public domain is another way of greatly increasing impact without affecting cost.
Finally, we caution researchers to avoid pursuing thankless tasks, activities that are high-effort and low-impact. If a researcher wishes to pursue an investigation in this area, we recommend identifying ways to minimize resource needs in addition to modifying the design to improve on effectiveness. As previously mentioned, one method for minimizing resource need is by increasing access to more readily available existing articles and research. Additionally, conducting research studies with volunteer students, both as research assistants and participants, can provide an enriching experience to learn more about the field in exchange for their time investment. Working with graduate and undergraduate students as research assistants to manage studies may provide valuable career experience. As for research participation, if fair compensation is prohibitive, another consideration is to offer extra credit for students in accordance with your institutional review board. Additionally, another method for reducing resource needs is to collaborate with other researchers, both interdisciplinary and across departments to pool resources. For example, if your university has a computer science department, the program may be willing to help develop a technology-based application or program for your study. Research on technology tends to be expensive and therefore sharing resources among professionals can save money.
We commend White etal. (Reference White, Ravid, Siderits and Behrend2022) for their call to drive timelier research. Yet, as discussed, there will always be friction in producing timely technology research due to expanding computing power, the time needed to diffuse technology through a population, and the risk associated with studying technologies that have their own demise preplanned. We argue that applying a prudent researcher standard and adopting the framework outlined in Figure 1 can help I-O psychologists produce timelier research while acknowledging the barriers. Finally, we add to the call by aligning White etal.’s proposed directions with the framework and offer additional ideas. As a whole, we suggest that the field of I-O psychology would make the greatest strides in producing timelier research on technology where effort is low in terms of resource considerations and yields the highest potential value across multiple levels.

