Abstract
This paper examines whether and how in-person communication influences the quality of information available to market participants. We utilize the lockdown periods during the COVID-19 pandemic as a proxy for an exogenous reduction in in-person communication, and analyst forecast accuracy as a proxy for information quality. We document that when firms’ headquarter states undergo lockdowns, analyst forecasts for these firms issued in the lockdown periods are significantly less accurate than for other firms or other periods, with an average difference of about 8% of the mean value of absolute forecast errors. The difference is also greater when analysts have less firm-specific experience or cover more industries, or when firms are smaller or younger. Supplemental analyses show greater differences when companies convert from in-person to virtual events despite holding more of the latter. In addition, analysts input more effort and display more divergent opinions during the lockdown periods. The collective results indicate that when there is less in-person communication, forecast quality is lower despite more effort and similar or higher frequency of virtual communication.
Introduction
Prior research indicates that face-to-face interactions communicate information that is difficult to articulate verbally or in writing, especially tacit information relying on body language or eye contact (Rhoads, 2010). Senju and Johnson (2009) find that eye contact modulates social cognitive processes and moderates information that could be stifled by virtual communication. However, in-person communication tends to be costly for both companies and participants, and limits participation. Computer-mediated or virtual communication offers a less costly and potentially effective alternative to a broad base of market participants, and the saved time and resources can be utilized in generating higher-quality work (Baek, 2023; Ferrazzi & Zapp, 2020). Some psychologists suggest that virtual collaboration may lead to more focused and comprehensive decisions as it could remove noise associated with body language or speech (Armstrong, 2006; Rhoads, 2010). In addition, technological development in recent years, such as live video conferences, provides features that enable more information-enhancing interactions among the participants (Brucks & Levav, 2022). This raises the question of whether in-person contact influences the quality of information available to capital markets when virtual communication potentially serves as a substitute.
The question is also motivated by the rising popularity of remote channels, such as teleconferences and webinars, that could replace or reduce in-person communication (Brochet et al., 2023; Brodsky & Tolliver, 2022; IR Magazine, 2023). 1 The switch to remote channels saves time and cost, and provides more convenient access to a larger audience and executives who could not attend in-person (Baek, 2023; Bloom et al., 2015). Examining firms that switch for this reason may bias toward finding improvement in information quality after the switch. On the other hand, management may willfully choose virtual communication to avoid shareholder scrutiny and become less transparent, for example, through allocating less time to shareholder questions (Brochet et al., 2023). Such switches can bias toward finding deterioration in information quality. Accordingly, it is important to account for the endogeneity in the switch from in-person to virtual channels. 2
We avoid this endogenous choice by exploiting an exogenous reduction in in-person communication during the period when lockdown and stay-at-home orders were issued in early 2020 across most U.S. states due to the COVID-19 pandemic. These lockdowns occurred over a staggered period, largely influenced by the rate of COVID transmission and political pressure within each state (Jacobsen & Jacobsen, 2020). During the lockdown periods, varying from 24 to 251 days across states, most firm events or other opportunities for communication were forced to be in a virtual format, resulting in an exogenous reduction in affected firms’ in-person communication to the markets. To gauge information quality, we use analyst forecast accuracy (De Franco et al., 2011; Lang et al., 2003) because analysts are sophisticated players in the market and provide a powerful setting for identifying information distributed by companies. 3 In addition, analysts’ output is measurable, a feature that facilitates the empirical analysis of information quality.
Our main sample includes 166,302 analyst forecasts issued in 2019 and 2020. We analyze analyst forecast accuracy with a generalized difference-in-differences research design that controls for firm, year, and week fixed effects, in addition to specific characteristics of analyst, forecast, and firm. Firm characteristics include changes in business fundamentals, management disclosure levels, and internal information quality. The fixed effects are feasible due to the staggered nature of the lockdowns and the large variation in lockdown period across states. They enable us to compare the effect of lockdown on forecast accuracy across time within firms, during the same time between states with different lockdown status in 2020, while using forecasts for the same firms in 2019 as a counterfactual. Further analyses also add analyst fixed effects and document similar effects for the same analysts forecasting firms in states under lockdown versus other firms not under lockdown. These fixed effects mitigate the concern that macroeconomic conditions or uncontrolled analyst or firm characteristics – such as variation in lockdown status among analysts or changes in business fundamental – drive the differences in forecast errors. We document significantly larger absolute errors of forecasts issued when firms’ headquarter states undergo lockdowns, by about 8% of the mean value. These results are consistent with deteriorating information quality when in-person communication is likely to be reduced.
In cross-sectional tests, we document larger forecast errors for analysts with less firm-specific experience or broader industry coverage and for younger or smaller firms. These analysts presumably face more challenges to read nonverbal cues due to having fewer interactions with the management prior to the lockdown periods or being stretched over heterogenous industries. Younger or smaller firms tend to have sparse information available and the reduction in in-person communication has a relatively higher impact on their overall information environment. The variation in results further supports the adverse influence of reduced in-person communication on information quality.
We conduct two supplement tests and four robust checks to validate the main results. The first supplemental test focuses on the sample of forecasts issued in the 2020 lockdown period and those for the same set of firms during the corresponding period in 2019 (hereafter, the pseudo-lockdown period). We manually collect in-person and virtual events that are held or participated by firms and explicitly consider the modality of events preceding analyst forecasts in both periods. We document an increase in forecast errors when firms switch from in-person events to virtual events, irrespective of whether more virtual events are held. In contrast, in a falsification test that compares forecasts made after virtual events in both periods for the same firms, we do not find a significant increase in forecast error. Although low power associated with the small number of virtual events in the pseudo-lockdown periods could potentially explain the insignificance, we note that the coefficient is about 55% of the documented effect when firms switch from in-person to virtual events. Overall, these results strengthen our argument that reduced in-person communication from the firms is the mechanism underlying increased forecast errors.
We next compare forecast errors by analysts located in states under lockdown with those by other analysts covering the same firm-years. We find that the former are significantly larger than the latter. These results based on analyst lockdown status triangulate our main results based on firm lockdown status.
We further conduct four tests to check the robustness of the main results, including the application of robust regressions to mitigate the influence of outliers; adjusting the lockdown indicator for forecasts issued after in-person events held right before the lockdown; separately considering firms that issued guidance during the 2019 pseudo-lockdown period but discontinued it during the 2020 lockdown period; and analyzing only industries of essential business whose business fundamentals are less affected by COVID-19. 4 All four tests continue to support our inferences that reduced in-person communication leads to significantly larger forecast errors.
In light of reduced forecast accuracy, we further examine analyst effort and forecast dispersion to more fully gauge the impact of reduced in-person communication on analyst activity and forecast quality. We find that analysts significantly increase forecast frequency during the COVID lockdown periods, which suggests increased effort input by analysts (Jacob et al., 1999). Additionally, in the lockdown periods, the dispersion of analyst earnings estimates is significantly higher, consistent with more disagreement among analysts when in-person communication is more limited (Diether et al., 2002; Thomas, 2002). Taken together, these results suggest that as compared to virtual communication, in-person communication reduces analyst effort and enhances analyst forecast quality.
This paper contributes to the literature by furthering the understanding of channels through which information is distributed to capital markets, in particular whether the in-person format aids the distribution incrementally to the virtual format. Our analyses answer the call by Bushee et al. (2011, p. 1188) for future research to “provide new insights into not only the market response to voluntary disclosure, but also the choice of voluntary disclosure venues.” Our finding that reduced in-person contact is related to significantly lower analyst forecast accuracy suggests a benefit of in-person contact that is not fully attained through virtual contact. Given the rise in virtual communication, our findings offer an important aspect to consider when making choices of communication modality (Brochet et al., 2023; Brodsky & Tolliver, 2022; IR Magazine, 2023).
In addition, Soltes (2014) and Brown et al. (2015) document the importance of private communication for analyst research. We extend this literature by documenting the importance of in-person communication to their forecast quality. We find that despite more frequent virtual communication and increased analyst effort, when in-person communication is limited, forecast accuracy deteriorates and forecast dispersion increases.
Our study also contributes to the nascent literature on capital market impacts of the COVID-19 pandemic, such as market reactions to earnings news or analyst forecast during the pandemic (D’Augusta & Grossetti, 2023; Fabrizi et al., 2023; Kale & Kale, 2023), analyst forecast frequency, timeliness, and accuracy (Bilinski, 2023; Durney et al., 2024; Hao et al., 2022; Liu et al., 2023), and differing impact by genders (Du, 2023). This paper expands Hao et al. (2022) and Bilinski (2023) by not viewing firms and the pandemic period as homogeneous and considering the variation across firms and within the pandemic period in terms of information communication modality. This paper also complements concurrent working papers by Liu et al. (2023) and Durney et al. (2024). Both document that when analysts rely more on in-person interactions with informed parties – proxied with geographic proximity – their forecast accuracy declines during the lockdown period and several subsequent quarters. Different from those studies, we focus on firms' communication modality during the lockdown period and the overall impact on forecast accuracy for affected firms. Additionally, as Ben-Rephael et al. (2023) indicate, forecast accuracy decline stemming from reduced in-person interactions could potentially be compensated with increased remote working hours. We find that the overall information quality declines for firms experiencing reduced in-person communication, with cross-sectional variation. The decline is greater for smaller or younger firms, and for those that switch from in-person to virtual modality, but not for firms that maintain a virtual modality.
Literature Review and Hypothesis Development
Companies communicate information to market participants through both in-person and remote channels. Examples of the former are investor and analyst days, private meetings, road shows, and examples of the latter are conference calls and annual meetings through webcast (Brown et al., 2015; Bushee et al., 2018; Soltes, 2014). Over time, more events are held remotely instead of face-to-face (Brodsky & Tolliver, 2022; IR Magazine, 2023).
One stream of literature suggests that in-person contact facilitates communication of information that is difficult or infeasible to articulate virtually or in writing (Rhoads, 2010). As a result, reduced in-person communication leads to a loss of information due to the loss of tacit information and nonverbal cues that are obtained through eye contact and body language (Bushee et al., 2011; Gajendran & Harrison, 2007; Senju & Johnson, 2009). Consistent with this literature, analysts surveyed by Deloitte cite face-to-face meetings as one of their preferred ways to find out about management leadership capabilities (Deloitte Global Services Limited, 2012, p. 7). Virtual meetings could also accord management more discretion in selecting shareholder questions and presentation content and suppress information spread (Schwartz-Ziv, 2021). Findings and arguments from the above literature suggest lower analyst research quality when firms eliminate or reduce in-person communication.
Other studies suggest that the remote format does not necessarily lead to information quality deterioration for the following reasons. First, replacing in-person contact with remote communication saves time and costs for the participants. The savings could facilitate more information communication through participation by more executives and investors (Baek, 2023; Ferrazzi & Zapp, 2020), or longer time spent on information acquisition from other channels (Causholli et al., 2022; Rhoads, 2010). Greater attendance could offset the reduction in virtual-meeting activity and result in no loss of information content when adopting a virtual format (Brochet et al., 2023). 5 As both effort on online information collection and that on in-person soft information acquisition are positively correlated with analyst forecast accuracy (Ben-Rephael et al., 2023), reduced face-to-face meetings coupled with greater effort in collecting information through virtual venues could lead to unchanged or improved information quality.
Second, virtual meetings allow participants to reflect before responding and are less susceptible to biases stemming from factors such as speech volume or meeting room furniture arrangement, as noted by Armstrong (2006). Thus, virtual meetings could lead to more focused and comprehensive decisions (Rhoads, 2010). In addition, Brucks and Levav (2022) suggest that virtual communication does not affect the effectiveness of selecting the most creative ideas as it “requires cognitive focus and analytical reasoning” (p. 108), a feature shared by financial analysts. To the extent that Brucks and Levav’s results could be generalized to analyst activity, virtual communication does not necessarily affect analyst forecast quality. The above discussions suggest that, when in-person contact is limited or eliminated, the affected market participants could replace it with remote channels and produce similar or higher-quality results.
Given the above discussion, ex ante, it is unclear whether and to what extent in-person contact affects analyst forecast quality. If virtual channels do not completely substitute for in-person contact in terms of information communication, we expect to observe lower analyst research quality when firms eliminate or reduce in-person communication. Otherwise, we expect to observe similar or higher analyst research quality. We summarize the above arguments with the hypothesis below.
Research Design
The COVID-19 pandemic led to stay-at-home orders across the United States, which concentrated in the period of late March to late May of 2020, and were somewhat staggered in that the ending date of the mandatory order varied by one or more months.
6
On average, the lockdown period lasted 57 days, with Mississippi at 24 days and New Mexico at 251 days. These orders lead to an exogenous reduction in in-person communication from firms. We use a binary variable LOCKDOWN to capture this period. As a proxy for information quality, we use analyst absolute forecast errors, with higher errors for lower information quality (De Franco et al., 2011; Lang et al., 2003). We start with descriptive statistics to compare forecast errors across time for the same firms and then utilize the multivariate regression below that controls for various analyst, firm, and forecast characteristics, as well as fixed effects for firm, year, and week.
As we define in Appendix A, ABS_FE ijd is the absolute difference between actual earnings and analyst i’s 1-year ahead earnings forecast issued on day d for firm j, scaled by the firm’s stock price at the fiscal year end. LOCKDOWNjd is an indicator that equals 1 if firm j’s headquarter state is subject to the stay-at-home order when the forecast is issued on day d. Control k includes analyst, forecast, and firm characteristics. Following Clement (1999), Clement and Tse (2003), and Jacob et al. (1999), we control for the following seven analyst and forecast characteristics: the number of days to the forecasted fiscal year end (FCST_HORIZON), brokerage size (BSIZE), the number of firms and industries covered by an analyst (#FIRMS and #INDUSTRIES), the number of years an analyst has covered the firm (FIRM_EXP), the number of 1-year-ahead earnings forecasts issued by the analyst for the same firm-year (FCST_FREQ), and the number of days since the latest one-year-ahead earnings forecast issued by any analyst for the same firms-year (DAYS_LASTFCST). All are measured in the 1-year period that precedes the current forecast date.
At the firm-year level, we control for changes in business fundamentals and the associated forecast difficulty with the absolute forecast error from a random walk model (ABS(UNEX_EARN)); management disclosure level with the availability of management guidance 1 month prior to analyst forecast date (MGT_EPS_GUIDE); and the quality of overall internal information environment with the speed of earnings announcement from the latest fiscal year end (EA_SPEED). Other controls for the influence of information environment include the number of analyst coverage (#ANALYSTS), total assets (SIZE), and firm age (AGE) (Barry & Brown, 1985; Mikhail et al., 1997; Zhang, 2006). Besides these annual measures of information quality, MGT_EPS_GUIDE also serves as a within-year proxy for information quality, with the issuance indicating higher information quality (Verrecchia, 1990; Waymire, 1985). Regression (1) also includes prior year return on assets (PY_ROA), leverage (LEVERAGE), and the logarithm of stock price (LN_PRICE) to account for variation in forecast errors with them.
We include firm fixed effects to control for other time-invariant firm characteristics not captured by the variables above; and year and week fixed effects for year-over-year economic changes and week-level fluctuations, respectively, in economic fluctuations and general uncertainty. Given the fixed effects, a positive coefficient on LOCKDOWN indicates greater errors of forecasts issued for firms undergoing lockdown relative to those for the same firms in other periods of 2020 or other firms in the same periods, net of weekly variation estimated for the 2019-2020 period.
In additional untabulated tests, we further include analyst fixed effects to account for across-analyst variation beyond the analyst characteristics explicitly controlled for in regression (1). As the lockdown periods are state specific, to account for the potential correlations in forecast errors among firms in the same state, we cluster standard errors by state. To the extent that the control variables in equation (1) fully account for variation in forecast errors with analyst and firm characteristics and economic uncertainty, the larger errors would be attributed to reduced in-person contact during the lockdown periods and support our hypothesis.
Sample Selection
Our sample includes firms with December 31 fiscal year end in Compustat from 2020, the COVID-19 event year, and 2019 as the control year. We require that the firms have headquarter addresses in Loughran and McDonald’s address data, and are covered by at least one analyst according to IBES in both years. As the stay-at-home order applies in the same calendar month for firms in the same state, we include only firms with December 31 as fiscal year ends to mitigate the effect of forecast horizon – which is relative to fiscal year end – on forecast accuracy. We use the headquarter addresses to identify the periods firms are subject to the lockdown orders. At the analyst-firm level, we keep only forecasts issued by analysts that cover a firm in both 2019 and 2020 to mitigate differences in forecast errors across different analysts. These criteria result in 166,302 forecasts made for 2,261 firms by 2,029 analysts in the 2 years.
Descriptive Statistics
Note. Panel A presents descriptive statistics of the main variables for the full sample of 1-year ahead earnings forecasts issued between 2019 and 2020. Panel B is for forecasts issued during the lockdown (pseudo-lockdown) periods in 2020 (2019) for firms whose headquarters are in the lockdown states. Pseudo-lockdown periods are the same periods in 2019 that correspond to the lockdown periods in 2020.
Next, to illustrate the effect of the change in communication modality on forecast errors, in Figure 1 we show the mean forecast errors for each week during the lockdown period in 2020. Because lockdowns occurred at different times for different states, we capture the first 10 weeks of lockdown rather than anchor on the same date, such that t = 1 is for the first week of a state’s lockdown and t = 10 for the 10th week. We then compare forecast errors in the 10 weeks with those for the same firms in the same periods in 2019. Mean Forecast Errors by Week into a Lockdown Period in 2020 Compared to a Pseudo-Lockdown Period in 2019.
Consistent with the literature (e.g., Clement & Tse, 2003), Figure 1 indicates that absolute forecast errors become smaller as forecast horizon shortens. The errors in the first week are similar between 2019 and 2020. However, as the forecast horizon shortens, analyst forecast errors decrease at a slower pace in the lockdown period in 2020 than those in the same weeks in 2019. The stock price-scaled difference in forecast errors is 0.31% in the first week, and ranges from 0.73% to 1.76% during the second to the 10th week. This result is consistent with inferior forecast quality during the lockdown period. Considering that analysts issue forecasts more frequently during the lockdown periods as indicated in Table 1, this suggests increased barriers to learn about earnings information as one potential explanation for the difference in forecast errors. Below we describe results from multivariate analyses.
Regression Results
Main Results and Analyses on Variation With Analyst and Firm Characteristics
Absolute Forecast Errors in the Lockdown Periods Versus Other Periods and Variation with Analyst and Firm Characteristics
Note. Column (1) reports the results of estimating the regression below for the average impact of lockdown on analyst forecast errors based on 166,302 1-year ahead analyst earnings forecasts issued in 2019 and 2020 for firms with December 31 fiscal year ends and one or more analyst coverage. Only forecasts issued by analysts who cover a firm in both years are retained. ABS_FEijd = α0 + α
1
LOCKDOWN
jd
+
We further examine variation in the main results with analyst and firm characteristics to enhance our argument for reduced in-person communication as the underlying mechanism. Regarding analyst characteristics, we expect analysts with shorter firm-specific experience (FIRM_EXP) or covering more industries (#INDUSTRIES) to face more challenges when receiving reduced in-person communication. The former group of analysts has not developed in-depth knowledge of the firms and management and is less likely to offset the loss of in-person communication with alternative sources. The latter group is more constrained in time and effort as their attention is dispersed across diverse industries. We augment regression (1) with the two variables and their interactions with LOCKDOWN in Columns (2) and (3) of Table 2. The significantly negative coefficient on LOCKDOWN*FIRM_EXP and positive coefficient on LOCKDOWN*#INDUSTRIES support our expectations. Taken together, these results are consistent with reduced in-person communication being related to lower analyst forecast accuracy through more demand for analyst’s effort and attention.
From the perspective of firms, for those with rich information available, when in-person contact is limited, the marginal reduction in information communicated is relatively small. Thus, we expect a more limited decrease in forecast quality during lockdowns for such firms. We proxy for firm information environments with firm age and size. Per columns (4) and (5) of Table 2, the coefficients on LOCKDOWN are significantly positive and the coefficients on its interaction terms are significantly negative. We thus infer that higher absolute forecast errors in the lockdown periods are driven by younger and smaller firms, which have more scarce overall information. Column (6) presents results when including all four interaction terms simultaneously. Except the interaction term on FIRM_EXP, which loses significance and magnitude, all interaction terms maintain a comparable magnitude and significance.
We infer from the overall results in Table 2 that reduced in-person communication negatively impacts forecast accuracy, especially for analysts with shorter firm-specific experience or covering more industries and for younger or smaller firms.
Analysis of Corporate Events During the Lockdown and Pseudo-Lockdown Period
Table 2 supports larger forecast errors for firms during the periods when they are subject to lockdown orders. We argue that reduced in-person communication from these firms explains the results and document variation in the results with analyst and firm characteristics that supports this argument. This section describes additional analyses to further validate this mechanism.
We first re-examine our primary analysis using a subsample of firms in lockdown states during the lockdown periods in 2020 and the pseudo-lockdown period in 2019, analogous to our descriptive tests reported in Figure 1 and Table 1. This test allows for a sharper analysis of forecasts that are for the same firms and same time periods across two adjacent years, mitigating the effect on forecast errors associated with differences in firms, states, or forecast horizons. A limitation with this analysis is that we lose observations for firms that are never subject to lockdowns (e.g., those in Iowa or Utah) and those made outside of the (pseudo) lockdown period in (2019) 2020.
Forecast Errors Around Events in Lockdown Versus Pseudo-lockdown Periods
Note. Column (1) examines forecasts issued during the 2020 lockdown periods for firms headquartered in the lockdown states and forecasts for the same firms during the 2019 pseudo-lockdown periods. In this subsample, LOCKDOWN is year-specific and renders year fixed effects unnecessary. Column (2) results are solely within firms that switch from in-person events in the 2019 pseudo-lockdown periods to virtual events in the 2020 lockdown periods. Column (3) limits the sample in column (2) to firms with the same number of, or more, events in the 2020 lockdown period compared to the 2019 pseudo-lockdown period. Column (4) presents a falsification test examining forecasts for firms involved in virtual events in both the 2019 pseudo-lockdown periods and the 2020 lockdown periods. All variables are defined in Appendix A. Robust t-statistics are in parentheses. Standard errors are clustered by firm. ***, **, * indicate p-values at 0.01, 0.05, and 0.10, respectively.
The analysis in column (1) that is solely within the same firms during the same weeks in 2020 versus 2019 provides more support for reduced in-person communication as a driver for higher forecast errors during the lockdown periods are likely driven by. To further validate this mechanism, we next limit our analysis to only analyst forecasts issued subsequent to corporate events and examine variation in forecast accuracy with the event modality. We use Capital IQ Key Development data, along with manual work, to collect dates and modality of three events, including analyst/investor days, company conference presentations, and special shareholders meetings. Appendix B provides details of the collection procedures. We select these events because they are mostly held in-person before the COVID pandemic and analysts actively participate in them or pay attention to them. In untabulated statistics, we observe a significant decrease in the proportion of in-person events, from 98.8% in 2019 to 48.6% in 2020, and a slight increase in the number of events, from 23,371 to 23,731.
In Column (2) of Table 3, we retain only forecasts issued within 1 month after corporate events for firms that switch between in-person events in the 2019 pseudo-lockdown period to virtual events in the 2020 lockdown period. This results in a sample of 8,046 analyst forecasts, of which 5,618 are in 2019 and 2,428 in 2020. Consistent with results in column (1), the coefficient on LOCKDOWN at 0.887 indicates significantly higher errors of forecasts issued subsequent to virtual events than errors of those issued after in-person events in 2019.
We note that the three types of events we focus on are either voluntarily organized by management (analyst-investor days and special or extraordinary shareholder meetings) or organized by third parties (company conference presentation), the latter accounting for more than 98% of our sample events. Because management has little to no discretion over these events – unlike shareholder annual meetings – information communicated therein is less likely to reflect management manipulation, such as allocating less time to audience questions (Schwartz-Ziv, 2021). We therefore infer that the decline in forecast accuracy following such events, as shown in column (2) of Table 3, is more likely driven by a change in communication modality than by management manipulation.
An alternative explanation for the larger forecast errors in the lockdown period is that firms participate in or hold fewer information events, as reflected in fewer events during the lockdown period than the pseudo-lockdown period. In other words, a reduction in overall information available to the analysts, rather than reduction in mere in-person communication potentially explains our main findings. To mitigate this concern, in Table 3, column (3), we further limit our sample to only firms that have a greater or equal number of events during the lockdown period compared to the pseudo-lockdown period. Based on this subsample of 2,407 forecasts, we continue to find significantly larger forecast errors following virtual events in the 2020 lockdown periods than those following in-person events in the 2019 pseudo-lockdown periods. We infer that having fewer information events is unlikely to explain the main results. Per columns (1) through (3), the coefficients on LOCKDOWN range from 38% (0.887/2.354) to 68% (1.611/2.354) of the mean forecast error in the pseudo-lockdown periods. In Section 6, we further examine whether outliers contribute to the large magnitude of the coefficient on LOCKDOWN.
Results in column (3) of Table 3 align more closely with the lack of tacit information as an explanation for the main results than with the management manipulation explanation. If management manipulates how virtual communication is conducted, for example, by shortening time allocated to the audience, it becomes increasingly difficult to sustain such behaviors when more virtual events are subsequently held. This is because the audience could repeatedly request additional time for previously unanswered questions. Under this view, more virtual events mitigate the reduction in information virtually conveyed and lessen the negative effects of virtual communication on forecast accuracy. Conversely, multiple virtual communications could lead to an accumulation of tacit information, meaning that the audience does not necessarily receive more and higher-quality information over more virtual events. Therefore, the result of worse forecast quality in column (3) is more consistent with the lack of tacit information than management manipulation as an explanation. 8
Finally, in Table 3, column (4), we perform a falsification test that examines forecasts that are issued in 1 month after virtual events in the 2019 pseudo- or 2020 actual lockdown periods for the same firms. For these forecasts, we anticipate that the lockdown has a weaker effect on the reduction of in-person communication. 9 Among the 4,227 forecasts, 3,952 (275) are in the lockdown (pseudo-lockdown) period, issued after 2,034 (23) virtual events in the corresponding period. In the lockdown (pseudo-lockdown) period, 14, 1997, and 23 (11, 11, and 1) events are analyst/investor days, company conference presentations, and special/extraordinary shareholder meetings, respectively. 10 The coefficient on LOCKDOWN in column (4) is insignificant and approximately half of the magnitude reported in column (2).
We also note that uncertainty associated with lockdowns affects all subsamples in Table 3. The lower and insignificant coefficient on LOCKDOWN for firms that maintain virtual communication is inconsistent with greater forecast errors being driven by higher uncertainty in the lockdown periods. However, we acknowledge that the small number of virtual events in 2019 may reduce the power of the test and contribute to the insignificant coefficient in column (4). We note this limitation and refrain from drawing a definitive conclusion based on this result. 11
Collectively, Table 3 shows reduced forecast accuracy when firms switch away from in-person events irrespective of whether more virtual events are held, and insignificant accuracy change when maintaining the virtual modality. These results strengthen our inference that reduced in-person communication from firms is related to information quality deterioration.
Additional Analyses and Robustness Tests
Lockdown Status Based on Analyst Location
Lockdown Status Based on Analyst Location
Note. This table presents results based on forecasts issued by analysts located in states different from the headquarter state of the covered firm. In this table, lockdown periods are defined based on analyst office locations (ANALYST_LOCKDOWN). All variables are defined in Appendix A. Robust t-statistics are in parentheses. Standard errors are clustered by state. ***, **, * indicate p-values at 0.01, 0.05, and 0.10, respectively.
Robust Regressions to Mitigate Effects of Outliers
Robust Regressions to Mitigate the Effect of Outliers
Note. This table presents results from robust regression analyses that assign lower weights to outliers in estimating the minimum aggregated residuals based on the total sample and the subsample from the lockdown and pseudo-lockdown periods. All variables are defined in Appendix A. Robust t-statistics are in parentheses. Standard errors are clustered by state. ***, **, * indicate p-values at 0.01, 0.05, and 0.10, respectively.
With the robust regression we continue to document significantly larger analyst forecast errors during lockdown periods, although with attenuated coefficients on LOCKDOWN. For example, the coefficient drops to 2.5% (0.084/3.388) for the main sample in Table 2, and to 7.0% (0.164/2.354) for the pseudo-lockdown subsample in Table 3. We infer that influential observations amplify, but do not manufacture, the effects we document.
As the robust regression downweights more influential observations, the attenuation of the robust regression coefficients relative to those from the OLS regression is expected and interpretable. The influential observations are likely those most affected by COVID-19 lockdowns, which caused severe and abrupt disruptions to firm operations and information environments. Large forecast errors among the most affected firms reflect real economic conditions, not data artifacts. Leone et al. (2019) emphasize that influential observations driven by real economic events represent legitimate data values, and that downweighting them risks attenuating the estimated effect precisely where treatment was most consequential. The OLS estimation captures the average effects on analyst forecast quality across the full distribution of treated firms, which aligns with our research question more appropriately than the effect from a reweighted distribution. We therefore treat Table 5 as confirming the robustness of our findings rather than as grounds to revise the primary estimates downward.
Additional Analyses of Analyst Effort and Forecast Dispersion
This section describes two additional analyses that examine the effect of reduced in-person information on analyst effort and forecast dispersion. First, we expect analysts to increase their effort to offset limitations to in-person dissemination of information and the associated challenges in interpreting information communicated through virtual channels. We proxy analyst effort input with the number of forecasts issued for each firm in a month (Jacob et al., 1999). We then estimate equation (1) with the natural logarithm of forecast frequency (LN(NUM_FCSTS)) as the dependent variable.
Second, we argue that reduced in-person communication could lead to higher forecast dispersion, an alternative proxy for information quality (De Franco et al., 2011; Gurun & Butler, 2012). This could arise in two ways. The first is through more difficulty in interpreting nonverbal cues and differential influence of this challenge on different analysts’ forecasting ability, which we document in Section 5 and Table 2. This influence likely leads to more divergent opinions among analysts, and thus, higher forecast dispersion (Diether et al., 2002; Thomas, 2002). In the second way, forecasts dispersion could rise when analysts place more weight on their private information and less on public information when the latter has less clarity (De Franco et al., 2011).
On the other hand, if analysts rationally recognize the differential influence of reduced in-person contact on their peers, they may herd towards the forecasts by those less affected, a tendency that would lead to lower forecast dispersion (Liu & Natarajan, 2012; Ramnath et al., 2012). We measure forecast dispersion with the standard deviation of analyst earnings estimates in a month (SD_FCSTS) and estimate equation (1) with SD_FCSTS as the dependent variable.
As both SD_FCSTS and LN(NUM_FCSTS) require a time window to measure, we collapse our data to firm-year-month observations. Accordingly, we modify LOCKDOWN to take the value of 1 if a lockdown appears during the firm-year-month, and 0 otherwise. Among the control variables, the focus at firm-year-month level renders those related to analysts or forecasts unnecessary. We thus retain only firm-related controls and firm and year fixed effects.
Firm-Month Analysis of Forecast Frequency and Dispersion During Lockdown Periods
Note. This table examines the effect of lockdowns on monthly analyst forecast frequency (NUM_FCSTS) and monthly dispersion of 1-year ahead earnings forecasts (SD_FCSTS). As the observations are for each firm-month, analyst level control variables are omitted. All variables are defined in Appendix A. Robust t-statistics are in parentheses. Standard errors are clustered by state. ***, **, * indicate p-values at 0.01, 0.05, and 0.10, respectively.
Column (2) of Table 6 reports a significant increase in analyst forecast dispersion during the month firms are subject to the lockdowns, by 40.53% of the sample mean at 0.324 or over 100% of the median at 0.120. Taken together, Table 6 shows that when in-person information is limited analysts both increase effort and exhibit more disagreement. In other words, despite more effort, analysts issue forecasts of lower quality during the lockdown periods when receiving less in-person communication from firms.
Alternative Measures of Lockdown
While the stay-at-home orders proxy for a plausibly exogenous reduction in firms’ in-person communication to market participants, using the period right after the effective date is subject to some noise when in-person communication occurred immediately before state-mandated lockdowns. To mitigate this confounding effect, we recode LOCKDOWN as 0 for forecasts issued during the lockdown period but within 1 month of an in-person event held just before the mandate, and label this adjusted measure ADJ_LOCKDOWN. 14
To identify such in-person communication, we use the corporate event data discussed in the previous section and in Appendix B. We replicate column (1) of Table 2 after replacing LOCKDOWN in regression (1) with ADJ_LOCKDOWN and document consistent results in Table OA1 in the Online Appendix. Relative to the LOCKDOWN coefficients in Table 2 and from the untabulated analyses that include various fixed effects, the ADJ_LOCKDOWN coefficients in Table OA1 are slightly larger (0.280, 0.390, and 0.267 versus 0.274, untabulated 0.381, and untabulated 0.260) and more statistically significant in two out of the three analyses. This suggests that the modified measure contains less measurement noise and better captures the effect of limited in-person information. The results strengthen our confidence that forecasts issued during the lockdown without information from in-person communication are indeed less accurate.
Control for Management Guidance Issuance
Hope et al. (2023) document 272 management guidance withdrawals in March 2020 because of economic uncertainty and increased analyst forecast dispersion following the withdrawal. We have controlled for management guidance issuance in the main analyses. To specifically address the possibility that lower management disclosure explains our findings, we separately examine firms that issued guidance during the 2019 pseudo-lockdown period but discontinued it during the 2020 lockdown period (STOP_GUIDE). Per results in Table OA2 in the Online Appendix, for these firms, the coefficients on LOCKDOWN are not significantly different from those for other firms, suggesting that changes in management earnings guidance disclosures are unlikely to fully explain our results.
Results Among Essential Business Industries
This section restricts the sample to firms in industries designated as essential businesses under federal critical infrastructure guideline. 15 Although lockdowns required all firms to hold corporate events virtually, they likely had a smaller impact on the business fundamentals of essential firms. Thus, changes in analyst forecast accuracy for these firms are less likely to be attributable to shifts in business fundamentals. We classify grocery (SIC 54), banks (60), utilities (49), hardware (52), communications (48), and defense (97) as essential industries and exclude those directly affected by the pandemic, including healthcare, gas stations, and transportation. Panel A of Table OA3 in the Online Appendix indicates that the magnitude of the coefficients on LOCKDOWN is comparable to those described in Section 5 based on the full sample. Panel B shows that the results remain robust to addressing outliers with robust regressions. These results further support the role of communication modality in driving the forecast errors.
Conclusion
We document a significant impact of in-person communication on analyst forecast accuracy. Focusing on firms whose headquarters undergo state-mandated lockdowns in early 2020 due to the COVID-19 pandemic, a period with little or no in-person communication from firms, we find that forecast errors for firms under lockdowns are significantly higher than in other periods or for other firms in the same periods. The increase amounts to about 8% of the mean absolute forecast error, suggesting that reduced in-person communication impairs the quality of information available to analysts. The effect is stronger for analysts with less firm-specific experience and broader industry coverage, as well as for smaller or younger firms. These are analysts that presumably face more challenges in filling the information gap caused by reduction of in-person communication, and firms that tend to have weaker information environment.
Further analyses show that firms switching from in-person events in the 2019 pseudo-lockdown periods to virtual events during lockdown experience higher forecast errors, whereas firms that maintain virtual communications do not. Although low power associated with the small number of virtual events in the pseudo-lockdown periods could influence the latter result, we note that the untabulated result from examining a larger number of virtual events in the full year of 2019 remain consistent. We also find that analysts exert greater effort and exhibit higher forecast dispersion during lockdowns.
Our finding of larger forecast errors during the lockdown periods is robust to a plethora of additional tests, including considering whether analysts are located in states under lockdowns, applying robust regressions to address outliers, adjusting the lockdown measure to reduce potential measurement error, accounting for firms that withdrew management guidance, and restricting the sample to essential industries whose business fundamentals are less affected by COVID-19. Collectively, the evidence indicates that despite increased analyst effort, reduced in-person interaction lowers analyst forecast quality. Although we cannot fully rule out correlated omitted variables confounding our results, the consistency of the results supports a role for communication modality in driving forecast errors.
These findings underscore the importance of in-person communication in facilitating information flow in capital markets and highlight potential information quality deterioration upon shifting to virtual formats. Firms weighing virtual versus in-person modalities should balance the savings in cost and time and broader participation associated with virtual communication against the potential decline in perceived information quality. Such a tradeoff is especially relevant for companies in weaker information environments and for market participants facing greater challenges in interpreting more subtle information.
Supplemental Material
Supplemental Material - The Impact of Reduced In-Person Contact on Information Quality: The Case of Analyst Forecast Accuracy During COVID Lockdowns
Supplemental Material for The Impact of Reduced In-Person Contact on Information Quality: The Case of Analyst Forecast Accuracy During COVID Lockdowns by Trent Krupa, Yanhua Sunny Yang, Xiao Yu in Journal of Accounting, Auditing & Finance
Footnotes
Acknowledgements
We are grateful for the support of our respective institutions and for helpful comments from Xiao-Jun Zhang (Editor in Chief), Suresh Radhakrishnan (Associate Editor), an anonymous reviewer, Vishal Baloria, Alina Lerman, Frank Murphy, George Plesko, Michael Willenborg, Ying Zhou, and seminar participants at the University of Connecticut and the University of Massachusetts at Dartmouth. We thank Tyler Johnson, Vernan Rivera, Ashley Schmid, and Anthony Barile for their excellent research assistance.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Supplemental Material
Supplemental material for this article is available online.
Notes
Author Biographies
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
