Authors:C. Ben Gibson, Jeannette Sutton, Sarah K. Vos, Carter T. Butts Abstract: Sociological Methods & Research, Ahead of Print. Microblogging sites have become important data sources for studying network dynamics and information transmission. Both areas of study, however, require accurate counts of indegree, or follower counts; unfortunately, collection of complete time series on follower counts can be limited by application programming interface constraints, system failures, or temporal constraints. In addition, there is almost always a time difference between the point at which follower counts are queried and the time a user posts a tweet. Here, we consider the use of three classes of simple, easily implemented methods for follower imputation: polynomial functions, splines, and generalized linear models. We evaluate the performance of each method via a case study of accounts from 236 health organizations during the 2014 Ebola outbreak. For accurate interpolation and extrapolation, we find that negative binomial regression, modeled separately for each account, using time as an interval variable, accurately recovers missing values while retaining narrow prediction intervals. Citation: Sociological Methods & Research PubDate: 2020-07-29T09:47:09Z DOI: 10.1177/0049124120926210
Authors:Siwei Cheng Abstract: Sociological Methods & Research, Ahead of Print. One of the most important developments in the current era of social sciences is the growing availability and diversity of data, big and small. Social scientists increasingly combine information from multiple data sets in their research. While conducting statistical analyses with linked data is relatively straightforward, borrowing information across unlinked data can be much more challenging due to the absence of unit-to-unit linkages. This article proposes a new methodological approach for borrowing information across unlinked surveys to predict unobserved distributions. The gist of the proposed approach lies in the idea of using the relative density between the observed and unobserved distributions in the reference data to characterize the difference between the two distributions and borrow that information to the base data. Relying on the assumption that the relative density between the observed and unobserved distributions is similar between data sets, the proposed relative density approach has the key advantage of allowing the researcher to borrow information about the shape of the distribution, rather than a few summary statistics. The approach also comes with a method for incorporating and quantifying the uncertainty in its output. We illustrate the formulation of this approach, demonstrate with simulation examples, and finally apply it to address the problem of employment selection in wage inequality research. Citation: Sociological Methods & Research PubDate: 2020-07-10T09:37:32Z DOI: 10.1177/0049124120926214
Authors:Gabriel Abend Abstract: Sociological Methods & Research, Ahead of Print. I argue that what-makes-it-possible questions are a distinct and important kind of sociological research question. What is social phenomenon P made possible or enabled by' Results won’t be about P’s causes and causal relationships, but about its enablers and enabling relationships. I examine the character of what-makes-it-possible questions and claims, how they can be empirically investigated, and what they’re good for. If I’m right, they provide a unique perspective on social phenomena, they show how the social world doesn’t come ready-made, and they open up new avenues for research. Citation: Sociological Methods & Research PubDate: 2020-07-10T09:34:32Z DOI: 10.1177/0049124120926204
Authors:Laura García-Montoya, James Mahoney Abstract: Sociological Methods & Research, Ahead of Print. This article develops a framework for the causal analysis of critical events in case study research. A critical event is defined as a contingent event that is causally important for an outcome in a specific case. Using set-theoretic analysis, this article offers definitions and measurement tools for the study of contingency and causal importance in case study research. One set of tools consists of guidelines for using theoretical expectations to arrive at conclusions about the level of contingency of events. Another set of tools are guidelines for using counterfactual cases to determine the extent to which a given event is necessary and sufficient for a particular outcome in an individual case. Examples from comparative and international studies are used to illustrate the framework. Citation: Sociological Methods & Research PubDate: 2020-07-08T10:39:16Z DOI: 10.1177/0049124120926201
Authors:Iasonas Lamprianou Abstract: Sociological Methods & Research, Ahead of Print. This study investigates inter- and intracoder reliability, proposing a new approach based on social network analysis (SNA) and exponential random graph models (ERGM). During a recent exit poll, the responses of voters to two open-ended questions were recorded. A coding experiment was conducted where a group of coders coded a sample of text segments. Analyzing the data, we show that the proposed SNA/ERGM method extends significantly our analytical leverage, beyond what popular tools such as Krippendorff’s α and Fleiss’s κ have to offer. The reliability of coding for individual coders differed significantly for the two questions although they were very similar and the same codebook was used. We conclude that the main advantages of the proposed SNA/ERGM method are the intuitive visualizations and the nuanced measurements. Detailed guidelines are provided for practitioners who would like to use the proposed method in operational settings. Citation: Sociological Methods & Research PubDate: 2020-06-24T09:17:11Z DOI: 10.1177/0049124120926198
Authors:Simon Kühne Abstract: Sociological Methods & Research, Ahead of Print. Survey interviewers can negatively affect survey data by introducing variance and bias into estimates. When investigating these interviewer effects, research typically focuses on interviewer sociodemographics with only a few studies examining the effects of characteristics that are not directly visible such as interviewer attitudes, opinions, and personality. For the study at hand, self-reports of 1,212 respondents and 116 interviewers, as well as their interpersonal perceptions of each other, were collected in a large-scale, face-to-face survey of households in Germany. Respondents and interviewers were presented with the same questions regarding their opinions and mutual perceptions toward social and political issues in Germany. Analyses show that interviewer effects can be largely explained by how an interviewer is seen by respondents. This indicates that some respondents adjust their answers toward anticipated interviewer opinions. Survey practitioners ought to acknowledge this in their survey design and training of interviewers. Citation: Sociological Methods & Research PubDate: 2020-06-15T08:58:44Z DOI: 10.1177/0049124120926215
Authors:Tobias Rüttenauer, Volker Ludwig Abstract: Sociological Methods & Research, Ahead of Print. Fixed effects (FE) panel models have been used extensively in the past, as those models control for all stable heterogeneity between units. Still, the conventional FE estimator relies on the assumption of parallel trends between treated and untreated groups. It returns biased results in the presence of heterogeneous slopes or growth curves that are related to the parameter of interest (e.g., selection into treatment is based on individual growth of the outcome). In this study, we derive the bias in conventional FE models and show that fixed effects individual slope (FEIS) models can overcome this problem. This is a more general version of the conventional FE model, which accounts for heterogeneous slopes or trends, thereby providing a powerful tool for panel data and other multilevel data in general. We propose two versions of the Hausman test that can be used to identify misspecification in FE models. The performance of the FEIS estimator and the specification tests is evaluated in a series of Monte Carlo experiments. Using the examples of the marital wage premium and returns to preschool education (Head Start), we demonstrate how taking heterogeneous effects into account can seriously change the conclusions drawn from conventional FE models. Thus, we propose to test for bias in FE models in practical applications and to apply FEIS if indicated by the specification tests. Citation: Sociological Methods & Research PubDate: 2020-06-10T06:54:53Z DOI: 10.1177/0049124120926211
Authors:Rafael Quintana Abstract: Sociological Methods & Research, Ahead of Print. Causal search algorithms have been effectively applied in different fields including biology, genetics, climate science, medicine, and neuroscience. However, there have been scant applications of these methods in social and behavioral sciences. This article provides an illustrative example of how causal search algorithms can shed light on important social and behavioral problems by using these algorithms to find the proximal mechanisms of academic achievement. Using a nationally representative data set with a wide range of relevant contextual and psychological factors, I implement four causal search procedures that varied important dimensions in the algorithms. Consistent with previous research, the algorithms identified prior achievement, executive functions (in particular, working memory, cognitive flexibility, and attentional focusing), and motivation as direct causes of academic achievement. I discuss the advantages and limitations of graphical models in general and causal search algorithms in particular for understanding social and behavioral problems. Citation: Sociological Methods & Research PubDate: 2020-06-09T09:34:36Z DOI: 10.1177/0049124120926208
Authors:Fleur Sharafizad, Kerry Brown, Uma Jogulu, Maryam Omari Abstract: Sociological Methods & Research, Ahead of Print. This article presents an adaptation of an arts-based research method usually reserved for child-focused research to examine organizational processes. We developed Draw, Write, Reflect (DWR), advancing a known method, Draw and Write, for investigating phenomena relating to child participants, to explore a new context: adults engaging in academic careers. This article reports on the rationale behind the novel use of this research method, outlines a DWR procedure for future research, and contains reflections of both the researchers and the respondents regarding their experiences participating in DWR. Offering participants a combination of visual and oral methods allowed the researchers to obtain data in a more individualized approach steered by participants’ preferences. The multidimensional insights obtained through DWR would not have been attainable through each method on its own. Furthermore, we argue arts-based research can serve as a vehicle for disseminating academic work beyond conventional academe to a growing, nonacademic audience. Citation: Sociological Methods & Research PubDate: 2020-05-28T10:39:01Z DOI: 10.1177/0049124120926206
Authors:Dingjing Shi, Xin Tong Abstract: Sociological Methods & Research, Ahead of Print. This study proposes a two-stage causal modeling with instrumental variables to mitigate selection bias, provide correct standard error estimates, and address nonnormal and missing data issues simultaneously. Bayesian methods are used for model estimation. Robust methods with Student’s t distributions are used to account for nonnormal data. Ignorable missing data are handled by multiple imputation techniques, while nonignorable missing data are handled by an added-on selection model structure. In addition to categorical treatment data, this study extends the work to continuous treatment variables. Monte Carlo simulation studies are conducted showing that the proposed Bayesian approach can well address common issues in existing methods. We provide a real data example on the early childhood relative age effect study to illustrate the application of the proposed method. The proposed method can be easily implemented using the R software package "ALMOND" (Analysis of Local Average Treatment Effect for missing or/and Nonnormal Data). Citation: Sociological Methods & Research PubDate: 2020-05-20T09:23:32Z DOI: 10.1177/0049124120914920
Authors:Carina Cornesse, Annelies G. Blom Abstract: Sociological Methods & Research, Ahead of Print. Recent years have seen a growing number of studies investigating the accuracy of nonprobability online panels; however, response quality in nonprobability online panels has not yet received much attention. To fill this gap, we investigate response quality in a comprehensive study of seven nonprobability online panels and three probability-based online panels with identical fieldwork periods and questionnaires in Germany. Three response quality indicators typically associated with survey satisficing are assessed: straight-lining in grid questions, item nonresponse, and midpoint selection in visual design experiments. Our results show that there is significantly more straight-lining in the nonprobability online panels than in the probability-based online panels. However, contrary to our expectations, there is no generalizable difference between nonprobability online panels and probability-based online panels with respect to item nonresponse. Finally, neither respondents in nonprobability online panels nor respondents in probability-based online panels are significantly affected by the visual design of the midpoint of the answer scale. Citation: Sociological Methods & Research PubDate: 2020-05-06T10:11:36Z DOI: 10.1177/0049124120914940
Authors:Marco Giesselmann, Alexander W. Schmidt-Catran Abstract: Sociological Methods & Research, Ahead of Print. An interaction in a fixed effects (FE) regression is usually specified by demeaning the product term. However, algebraic transformations reveal that this strategy does not yield a within-unit estimator. Instead, the standard FE interaction estimator reflects unit-level differences of the interacted variables. This property allows interactions of a time-constant variable and a time-varying variable in FE to be estimated but may yield unwanted results if both variables vary within units. In such cases, Monte Carlo experiments confirm that the standard FE estimator of x ⋅ z is biased if x is correlated with an unobserved unit-specific moderator of z (or vice versa). A within estimator of an interaction can be obtained by first demeaning each variable and then demeaning their product. This “double-demeaned” estimator is not subject to bias caused by unobserved effect heterogeneity. It is, however, less efficient than standard FE and only works with T> 2. Citation: Sociological Methods & Research PubDate: 2020-04-28T09:47:08Z DOI: 10.1177/0049124120914934
Authors:Roel Rutten Abstract: Sociological Methods & Research, Ahead of Print. Applying qualitative comparative analysis (QCA) to large Ns relaxes researchers’ case-based knowledge. This is problematic because causality in QCA is inferred from a dialogue between empirical, theoretical, and case-based knowledge. The lack of case-based knowledge may be remedied by various robustness tests. However, being a case-based method, QCA is designed to be sensitive to such tests, meaning that also large-N QCA robustness tests must be evaluated against substantive knowledge. This article connects QCA’s substantive-interpretation approach of causality to critical realism. From that perspective, it identifies relevant robustness tests and applies them to a real-data large-N QCA study. Robustness test findings are visualized in a robustness table, and this article develops criteria to substantively interpret them. The robustness table is introduced as a tool to substantiate the validity of causal claims in large-N QCA studies. Citation: Sociological Methods & Research PubDate: 2020-04-27T06:43:37Z DOI: 10.1177/0049124120914955
Authors:Annette Lareau, Aliya Hamid Rao Abstract: Sociological Methods & Research, Ahead of Print. There is a dearth of methodological guidance on how to conduct participant observation in private spaces such as family homes. Yet, participant observations can provide deep and valuable data about family processes. This article draws on two ethnographic studies of family life in which researchers conduct in-depth interviews, recruit families, and ultimately enter the family as a quasi-stranger for daily observations lasting a fixed period (e.g., three weeks). We term this approach “intensive family observations.” Here, we provide concrete methodological advice for this method, beginning with guidelines for recruitment and gaining consent. We also discuss logistics of conducting family observation (e.g., scheduling, spatial positionality in the home, role in the field, among other issues). We elaborate on the key challenges, specifically issues of intrusion, power, and positionality. Last, we reflect on how this method provides opportunities for accurately capturing deeply intimate moments as well as unexpected insights. Citation: Sociological Methods & Research PubDate: 2020-04-24T09:45:50Z DOI: 10.1177/0049124120914949
Authors:Alex Koch, Felix Speckmann, Christian Unkelbach Abstract: Sociological Methods & Research, Ahead of Print. Measuring the similarity of stimuli is of great interest to a variety of social scientists. Spatial arrangement by dragging and dropping “more similar” targets closer together on the computer screen is a precise and efficient method to measure stimulus similarity. We present Qualtrics-spatial arrangement method (Q-SpAM), a feature-rich and user-friendly online version of spatial arrangement. Combined with crowdsourcing platforms, Q-SpAM provides fast and affordable access to similarity data even for large stimulus sets. Participants may spatially arrange up to 100 words or images, randomly selected targets, self-selected targets, self-generated targets, and targets self-marked in different colors. These and other Q-SpAM features can be combined. We exemplify how to collect, process, and visualize similarity data with Q-SpAM and provide R and Excel scripts to do so. We then illustrate Q-SpAM’s versatility for social science, concluding that Q-SpAM is a reliable and valid method to measure the similarity of lots of stimuli with little effort. Citation: Sociological Methods & Research PubDate: 2020-04-24T09:43:10Z DOI: 10.1177/0049124120914937
Authors:Grace Li, Mary Lesperance, Zheng Wu Abstract: Sociological Methods & Research, Ahead of Print. The Cox proportional hazards model has been pervasively used in many social science areas to examine the effects of covariates on timing to an event. The standard Cox model is intended to study univariate survival data where there is a singular event of interest, which can only be experienced once. However, we may additionally wish to explore a number of other complexities that are prevalent in survival data. For example, an individual may experience events of the same type more than once or may experience multiple types of events. This study introduces innovations in recurrent (repeatable) event analysis, jointly modeling several endogenous survival processes. As an example and an application, we simultaneously model two types of recurrent events in the presence of a dependent terminal event. This model not only correctly handles different types of recurrent events but also explicitly estimates the direction and magnitude of relationships between recurrences and survival. This article concludes with an example of the model to examine how the timing of retirement is associated with the risks of multiple spells of employment and childbearing. The theoretical discussions and empirical analyses suggest that the multivariate joint models have much to offer to a wide variety of substantive research areas. Citation: Sociological Methods & Research PubDate: 2020-04-24T09:40:43Z DOI: 10.1177/0049124120914928
Authors:Tobias Gummer, Bella Struminskaya Abstract: Sociological Methods & Research, Ahead of Print. Reluctance of respondents to participate in surveys has long drawn the attention of survey researchers. Yet, little is known about what drives a respondent’s decision to answer the survey invitation early or late during the field period. Moreover, we still lack evidence on response timing in longitudinal surveys. That is, the questions on whether response timing is a rather stable respondent characteristic and what—if anything—affects change in response timing across different interviews remain open. We relied on data from a mixed-mode general population panel survey collected between 2014 and 2016 to study the stability of response timing across 18 panel waves and factors that influence the decision to participate early or late in the field period. Our results suggest that the factors which had effects on response timing are different in the mail and web modes. Moreover, we found that experience with prior panel waves affected the respondent’s decision to participate early or late. Overall, the present study advocates understanding response timing as a metric variable and, consequently, the need to reflect this in modeling strategies. Citation: Sociological Methods & Research PubDate: 2020-04-22T10:04:32Z DOI: 10.1177/0049124120914921
Authors:Shu-Hui Hsieh, Pier Francesco Perri Abstract: Sociological Methods & Research, Ahead of Print. We propose some theoretical and empirical advances by supplying the methodology for analyzing the factors that influence two sensitive variables when data are collected by randomized response (RR) survey modes. First, we provide the framework for obtaining the maximum likelihood estimates of logistic regression coefficients under the RR simple and crossed models, then we carry out a simulation study to assess the performance of the estimation procedure. Finally, logistic regression analysis is illustrated by considering real data about cannabis use and legalization and about abortion and illegal immigration. The empirical results bring out certain considerations about the effect of the RR and direct questioning survey modes on the estimates. The inference about the sign and the significance of the regression coefficients can contribute to the debate on whether the RR approach is an effective survey method to reduce misreporting and improve the validity of analyses. Citation: Sociological Methods & Research PubDate: 2020-04-20T10:18:13Z DOI: 10.1177/0049124120914950
Authors:Katja Prevodnik, Vasja Vehovar Abstract: Sociological Methods & Research, Ahead of Print. When comparing social science phenomena through a time perspective, absolute and relative difference (RD) are the two typical presentation formats used to communicate interpretations to the audience, while time distance (TD) is the least frequently used of such formats. This article argues that the chosen presentation format is extremely important because the various formats suggest different substantive interpretations. To elaborate upon this issue, researchers from the National Statistical Office, National Health Institute, and general academia were invited to participate in an experiment with alternative presentation formats that describe changes in certain social science phenomena over time. The results revealed a prevailing tendency of respondents to rely on interpretations related to absolute differences, which was additionally reinforced with graphical presentation formats. Therefore, whenever RD or TD is more proper for substantive interpretations, the corresponding presentation format must be designed with special attention. Citation: Sociological Methods & Research PubDate: 2020-04-20T10:08:13Z DOI: 10.1177/0049124120914948
Authors:Olav Muurlink, Anthony M. Gould, Jean-Etienne Joullié Abstract: Sociological Methods & Research, Ahead of Print. Development of graphical methods for representing data has not kept up with progress in statistical techniques. This article presents a brief history of graphical representations of research findings and makes the case for a revival of methods developed in the early and mid-twentieth century, notably ISOTYPE and Chernoff’s faces. It resurrects and improves a procedure, clustered iconography, which enables the presentation of multidimensional data through which readers engage more effectively with the presentation’s central message by way of an easier understanding of relationships between variables. The proposed technique is especially well adapted to the needs and protocols of open-source research. Citation: Sociological Methods & Research PubDate: 2020-04-10T10:30:49Z DOI: 10.1177/0049124120914943
Authors:Cheng Wang, Carter T. Butts, John Hipp, Cynthia M. Lakon Abstract: Sociological Methods & Research, Ahead of Print. The recent popularity of models that capture the dynamic coevolution of both network structure and behavior has driven the need for summary indices to assess the adequacy of these models to reproduce dynamic properties of scientific or practical importance. Whereas there are several existing indices for assessing the ability of the model to reproduce network structure over time, to date there are few indices for assessing the ability of the model to reproduce individuals’ behavior patterns. Drawing on the widely used strategy of assessing model adequacy by comparing index values summarizing features of the observed data to the distribution of those index values on simulated data from the fitted model, we propose four goals that a researcher could reasonably expect of a joint structure/behavior model regarding how well it captures behavior and describe indices for assessing each of these. These reasonably simple and easily implemented indices can be used for assessing model adequacy with any dynamic network models jointly working with networks and behavior, including the stochastic actor-based models implemented within software packages such as RSien version 1.2-24. We demonstrate the use of our indices with an empirical example to show how they can be employed in practical settings, with an additional extension to modeling affiliation dynamics in two-mode networks. Key scripts are provided in the Supplemental Document (which can be found at http://smr.sagepub.com/supplemental/). Citation: Sociological Methods & Research PubDate: 2020-04-10T10:15:08Z DOI: 10.1177/0049124120914933
Authors:Fabiola Reiber, Harrison Pope, Rolf Ulrich Abstract: Sociological Methods & Research, Ahead of Print. Randomized response techniques (RRTs) are useful survey tools for estimating the prevalence of sensitive issues, such as the prevalence of doping in elite sports. One type of RRT, the unrelated question model (UQM), has become widely used because of its psychological acceptability for study participants and its favorable statistical properties. One drawback of this model, however, is that it does not allow for detecting cheaters—individuals who disobey the survey instructions and instead give self-protecting responses. In this article, we present refined versions of the UQM designed to detect the prevalence of cheating responses. We provide explicit formulas to calculate the parameters of these refined UQM versions and show how the empirical adequacy of these versions can be tested. The Appendices contain R-code for all necessary calculations. Citation: Sociological Methods & Research PubDate: 2020-04-10T10:08:48Z DOI: 10.1177/0049124120914919
Authors:Geoff G. Cole Abstract: Sociological Methods & Research, Ahead of Print. In 2018, a peer-reviewed article was published under the name of Richard Baldwin in which the author presented a critique of fat exclusion and advocated “fat bodybuilding” as a sport. Some months later, it became apparent that the article was intended as a hoax written to raise awareness to, or “expose”, a certain ideology promoted by some academics. As a result, the editors retracted the article. Using the principles of methodological behaviorism, and other hoax or hoax-like articles, I will argue that the thoughts and opinions held by any author are not important to the argument they present. I will also argue that this form of reflexive ethnography is too problematic to serve as a method of enquiry. I will therefore conclude that the Baldwin article should be reinstated. Citation: Sociological Methods & Research PubDate: 2020-04-09T09:49:04Z DOI: 10.1177/0049124120914951
Authors:Marcin Hitczenko Abstract: Sociological Methods & Research, Ahead of Print. Researchers interested in studying the frequency of events or behaviors among a population must rely on count data provided by sampled individuals. Often, this involves a decision between live event counting, such as a behavioral diary, and recalled aggregate counts. Diaries are generally more accurate, but their greater cost and respondent burden generally yield less data. The choice of survey mode, therefore, involves a potential trade-off between bias and variance of estimators. We use a case study comparing inferences about payment instrument use based on different survey designs to illustrate this dilemma. We then use a simulation study to show how and under what conditions a hybrid survey design can improve efficiency of estimation, in terms of mean-squared error. Overall, our work suggests that such a hybrid design can have considerable benefits, as long as there is nontrivial overlap in the diary and recall samples. Citation: Sociological Methods & Research PubDate: 2020-04-09T09:47:25Z DOI: 10.1177/0049124119882465
Authors:Jette Schröder, Claudia Schmiedeberg Abstract: Sociological Methods & Research, Ahead of Print. Despite the fact that third parties are present during a substantial amount of face-to-face interviews, bystander influence on respondents’ response behavior is not yet fully understood. We use nine waves of the German Family Panel pairfam and apply fixed effects panel regression models to analyze effects of third-party presence on items regarding the sharing of household tasks between partners. We find that both male and female respondents report doing a smaller share of household tasks when their partner is present during the interview as compared to when their partner is not present. Similarly, if the respondent’s partner is present, both partners’ reports correspond more, so that they are less prone to resulting in unrealistically high sums. These results indicate that for items concerning household labor, partner presence does not compromise data quality but may in fact improve it. Citation: Sociological Methods & Research PubDate: 2020-04-07T10:22:51Z DOI: 10.1177/0049124120914938
Authors:Florian Keusch, Sebastian Bähr, Georg-Christoph Haas, Frauke Kreuter, Mark Trappmann Abstract: Sociological Methods & Research, Ahead of Print. Researchers are combining self-reports from mobile surveys with passive data collection using sensors and apps on smartphones increasingly more often. While smartphones are commonly used in some groups of individuals, smartphone penetration is significantly lower in other groups. In addition, different operating systems (OSs) limit how mobile data can be collected passively. These limitations cause concern about coverage error in studies targeting the general population. Based on data from the Panel Study Labour Market and Social Security (PASS), an annual probability-based mixed-mode survey on the labor market and poverty in Germany, we find that smartphone ownership and ownership of smartphones with specific OSs are correlated with a number of sociodemographic and substantive variables. The use of weighting techniques based on sociodemographic information available for both owners and nonowners reduces these differences but does not eliminate them. Citation: Sociological Methods & Research PubDate: 2020-04-07T10:20:51Z DOI: 10.1177/0049124120914924
Authors:Tenglong Li, Ken Frank Abstract: Sociological Methods & Research, Ahead of Print. The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index of causal inference. Formally, the PIV is the probability of rejecting the null hypothesis again based on both the observed sample and the counterfactuals, provided the same null hypothesis has already been rejected based on the observed sample. Under either frequentist or Bayesian framework, one can bound the PIV of an inference based on his bounded belief about the counterfactuals, which is often needed when the unconfoundedness assumption is dubious. The PIV is equivalent to statistical power when the NHST is thought to be based on both the observed sample and the counterfactuals. We summarize the process of evaluating internal validity with the PIV into a six-step procedure and illustrate it with an empirical example. Citation: Sociological Methods & Research PubDate: 2020-04-07T10:18:51Z DOI: 10.1177/0049124120914922
Authors:Shu-Hui Hsieh, Shen-Ming Lee, Chin-Shang Li Abstract: Sociological Methods & Research, Ahead of Print. Surveys of income are complicated by the sensitive nature of the topic. The problem researchers face is how to encourage participants to respond and to provide truthful responses in surveys. To correct biases induced by nonresponse or underreporting, we propose a two-stage multilevel randomized response (MRR) technique to investigate the true level of income and to protect personal privacy. For a wide range of applications, we present a proportional odds model for two-stage MRR data and apply inverse probability weighting and multiple imputation methods to deal with covariates on some subjects that are missing at random. A simulation study is conducted to investigate the effects of missing covariates and to evaluate the performance of the proposed methods. The practicality of the proposed methods is illustrated with the regular monthly income data collected in the Taiwan Social Change Survey. Furthermore, we provide an estimate of personal regular monthly mean income. Citation: Sociological Methods & Research PubDate: 2020-04-03T10:35:20Z DOI: 10.1177/0049124120914954
Authors:Assaf Rotman, Michael Shalev Abstract: Sociological Methods & Research, Ahead of Print. Automatically collected behavioral data on the location of users of mobile phones offer an unprecedented opportunity to measure mobilization in mass protests, while simultaneously expanding the range of researchable questions. Location data not only improve estimation of the number and composition of participants in large demonstrations. Thanks to high spatial and temporal resolution they also reveal when, where, and with whom different sociopolitical sectors join a protest campaign. This article compares the features and advantages of this type of data with other methods of measuring who participates in street protests. The steps in preparing a usable data set are explained with reference to a six-week campaign of mass mobilization in Israel in 2011. Findings based on the Israeli data set illustrate a wide range of potential applications, pertaining to both the determinants and consequences of protest participation. Limitations of mobile location data and the privacy issues it raises are also discussed. Citation: Sociological Methods & Research PubDate: 2020-04-03T10:33:41Z DOI: 10.1177/0049124120914926
Authors:Catherine E. Harnois, João L. Bastos, Salma Shariff-Marco Abstract: Sociological Methods & Research, Ahead of Print. The Everyday Discrimination Scale is the most commonly used instrument to assess discrimination. The survey asks respondents about a range of negative interpersonal experiences and then asks them to provide a single main reason for all these experiences. Theories of intersectionality cast doubt on the idea that marginalized individuals generally perceive a single reason for the discrimination they encounter. We analyze data from 23 cognitive interviews with racial/ethnic minority adults to assess the degree of difficulty respondents have in assessing the main reason for their mistreatment, the sources of this difficulty, and potential consequences. Of the 21 respondents who reported experiencing some form of everyday discrimination, 43 percent encountered some difficulty in identifying a single main reason for their experiences; 42 percent of women who perceived some form of discrimination evidence significant frustration in identifying a main reason. Analyses show that, by requiring respondents to identify a single reason for their experiences of discrimination, the resulting data likely provide underestimates—and potentially biased estimates—of particular forms of discrimination. Citation: Sociological Methods & Research PubDate: 2020-03-30T10:43:07Z DOI: 10.1177/0049124120914929
Authors:Josh Pacewicz Abstract: Sociological Methods & Research, Ahead of Print. Most social scientists agree that case studies are useful for “theory building,” but ethnographic methods papers often look to survey research for case selection strategies. This is due to a common but untenable distinction between theoretical and empirical generalization, which obscures how theoretically inclined ethnographers make implicit external validity claims. I analyze several exemplary ethnographies to show that (a) the distinction between theoretically and empirically oriented ethnography revolves around competing conventions for making claims that others accept as provisionally externally valid, (b) comparative-historical sociology provides a framework for evaluating how theoretically oriented ethnographies make such claims, and (c) each approach to making validity claims is optimized by different kinds of cases. Empirically oriented ethnographies make inductive claims via “pointy” cases wherein a phenomenon is pronounced or bifurcated. Theoretically oriented ethnographers are like post–Millian historical sociologist who triangulate past studies with resolutive or negative cases to make constitutive arguments. Citation: Sociological Methods & Research PubDate: 2020-02-13T10:43:13Z DOI: 10.1177/0049124119901213
Authors:Liying Luo, James S. Hodges Abstract: Sociological Methods & Research, Ahead of Print. Social scientists have frequently sought to understand the distinct effects of age, period, and cohort, but disaggregation of the three dimensions is difficult because cohort = period − age. We argue that this technical difficulty reflects a disconnection between how the cohort effect is conceptualized and how it is modeled in the traditional age-period-cohort framework. We propose a new method, called the age-period-cohort-interaction (APC-I) model, that is qualitatively different from previous methods in that it represents Ryder’s theoretical account about the conditions under which cohort differentiation may arise. This APC-I model does not require problematic statistical assumptions and the interpretation is straightforward. It quantifies inter-cohort deviations from the age and period main effects and also permits hypothesis testing about intra-cohort life-course dynamics. We demonstrate how this new model can be used to examine age, period, and cohort patterns in women’s labor force participation. Citation: Sociological Methods & Research PubDate: 2020-01-23T09:31:59Z DOI: 10.1177/0049124119882451
Hybrid journal (It can contain Open Access articles)
