Posts

Showing posts with the label Hessian

Metastability and Eye Movements: A Dynamical‑Systems Interpretation

  1. Why metastability is a natural language for gaze behavior The idea that perception, attention, and neural activity evolve through transiently stable states has deep roots in cognitive science and neuroscience. Concepts such as attractors , basins , noise‑induced transitions , and escape times appear in work on perceptual switching, decision‑making, and neural population dynamics (Kelso, 1995; Rabinovich et al., 2008; Deco & Jirsa, 2012). Eye movements, especially the alternation between fixations and saccades ,   fit remarkably well into this metastable picture. The Freidlin–Wentzell theory of rare events (Freidlin & Wentzell, 2012) provides a rigorous mathematical language for these intuitions. 2. Fixations as metastable states  Consider the gaze position X t as the state of a stochastic dynamical system. During a fixation the  gaze remains confined to a small region, microsaccades and noise generate small fluctuations, and the gaze tends to return...

Diagnosing Singular Fits in Linear Mixed Models: Practical Examples, Code, and Alternatives

Image
  Introduction This post is the practical follow‑up to When Linear Mixed Models Don’t Converge , where I discussed the theoretical reasons why convergence issues often arise in linear mixed models. Here, we move from theory to practice: simulated examples, diagnostic tools, interpretation of singular fits, and practical modeling alternatives. If you haven’t read the first part yet, you may want to start there for the conceptual foundations. Figure. Conceptual map showing how model complexity and available information interact Legend of Figure 1. Green = identifiable models; yellow = risk of singularity; red = non‑identifiable models. A Concrete Example Using R: When a Random-Slope Model Becomes Singular Let’s simulate a simple dataset with only 8 groups and a very small random‑slope variance. This is a classic scenario where the model converges numerically but is statistically non‑identifiable. ```r set.seed(123) n_groups <- 8 n_per_group <- 20 group <- factor(rep(1:n_gro...

When Linear Mixed Models Don’t Converge: Causes, Consequences, and Interpretation

  Introduction   Linear mixed-effects models (LMMs) have become a standard tool for analyzing correlated or hierarchical data across many applied fields, including biostatistics, psychology, ecology, and toxicology. Their appeal lies in the ability to model both population-level effects (fixed effects) and sources of variability associated with grouping or experimental structure (random effects) within a single coherent framework.   However, practitioners frequently encounter warning messages when fitting LMMs, such as “failed to converge,” “boundary (singular) fit,” or “Hessian not positive definite.” These warnings are often treated as technical nuisances or software-specific quirks, and it is tempting to either ignore them or attempt minor numerical fixes (e.g., changing optimizers or increasing iteration limits). Such warnings usually signal deeper statistical issues related to model identifiability and data support.   Convergence problems are especia...

Popular posts from this blog

Diagnosing Singular Fits in Linear Mixed Models: Practical Examples, Code, and Alternatives

Understanding Anaerobic Threshold (VT2) and VO2 Max in Endurance Training

Unit Root Testing in Practice: A Tutorial on ADF–KPSS, Specification, and Diagnostics