SOPHIE Daddy Quant Blog - Stock & Options Analysis

Core Theses

Predictive models relying exclusively on historical correlations degrade violently across regime changes.

Double Machine Learning neutralizes regularization bias, enabling unbiased causal parameter estimation in high-dimensional noise.

Continuous optimization (NOTEARS) and non-Gaussian frameworks (LiNGAM) can mathematically learn structural graphs directly from observational data.

✓

Replacing the Pearson matrix with the Interventional Covariance Matrix dramatically improves out-of-sample Sharpe ratios.

The Epistemological Crisis in Empirical Finance

•
Historically, quantitative finance relied on associational statistics (e.g., CAPM, Fama-French, standard deep learning).
•
Without causal frameworks, mining thousands of factors mathematically guarantees finding statistically significant but spurious correlations, artificially inflating the False Discovery Rate (FDR).
•
An investment strategy devoid of a formal causal theory is highly likely to be mathematically false out-of-sample.

Associational Inference (Seeing)

•Measured by Conditional Probability: P(Y|X)
•Relies on Undirected / Correlational graphs.
•Vulnerable to Confounding, Colliders, and Simpson's Paradox.
•Degrades during regime shifts.

Causal Inference (Doing)

•Measured by Do-Calculus: P(Y|do(X)) via SCMs.
•Relies on Directed Acyclic Graphs (DAGs) to map temporal flow.
•Actively mitigates spurious "factor mirages".
•Isolates invariant features robust to market turbulence.

Featured Infographic

The structural revolution in quantitative finance: causal inference vs correlational models

Theoretical Foundations: Graphing Market Structure

A Directed Acyclic Graph (DAG) maps the topological information of a system. Understanding this geometry is required to avoid destructive biases:

Confounding Bias

An unobserved variable causes both the treatment and the outcome. Failing to condition on it creates a spurious association.

Collider Bias

The treatment and the outcome both cause a third variable. Conditioning on a collider induces artificial correlation between independent variables.

High-Dimensional Parameter Estimation: Double Machine Learning

•
Standard ML architectures (Random Forests, DNNs) suffer from severe regularization bias, systematically shrinking causal parameter estimates toward zero and ruining inference.
•
Double Machine Learning (DML) neutralizes regularization bias, enabling the estimation of specific causal parameters amid high-dimensional nuisance covariates.

DML Orthogonalization Mechanics

// Let Y = Asset Return (Outcome)
// Let T = Interest Rate Shock (Treatment)
// Let X = Macro/Firm Covariates (High-Dim Confounders)

1. Cross-Fitting via ML:
   Predict Y given X -> Y_hat
   Predict T given X -> T_hat

2. Residualization (Isolating unconfounded variance):
   Y_res = Y_actual - Y_hat
   T_res = T_actual - T_hat

3. Neyman Orthogonal Estimation:
   Causal_Effect (θ) = OLS(Y_res ~ T_res)

// Result: θ achieves root-n consistency despite ML regularization in Step 1.

// The variance in T independent of X explains variance in Y independent of X.

Tackling Unobserved Confounding: Deep IV

•
When confounders (like hidden macro sentiment) are unobservable, researchers use Instrumental Variable (IV) regression.
•
Deep IV frameworks integrate neural networks into IV regression, modeling highly non-linear asset pricing structures while maintaining econometric unconfoundedness.

Causal Discovery: Inferring Structural Graphs

Causal Discovery mathematically learns the DAG directly from observational data, categorized into distinct algorithmic families:

Family	Mechanism	Quant Advantage
Constraint-Based (PC, FCI)	Conditional independence tests.	FCI mathematically handles unobserved confounders.
Continuous Optimization (NOTEARS)	Differentiable algebraic constraint.	Scales to large universes; integrates with NNs.
Non-Gaussian (LiNGAM)	Independent Component Analysis.	Orients causal arrows uniquely, resolving equivalence.

The Role of LLMs

LLMs act as "causal parrots" hallucinating relationships via linguistic co-occurrence. They must never independently arbitrate causality. Instead, they supply directional priors (soft constraints) to algorithms like NOTEARS, demonstrably boosting F1 accuracy on synthetic financial graphs by over 300%.

Causal Portfolio Analytics: Rethinking the Covariance Matrix

•
Modern Portfolio Theory relies on the Pearson matrix, capturing spurious correlations that notoriously converge toward 1.0 during market crashes.
•
The Interventional Covariance Matrix ( $\Sigma_{do}$ ) isolates structural dependencies by controlling for shared causal ancestors.
✓
Portfolios optimized on $\Sigma_{do}$ exhibit vastly superior out-of-sample Sharpe ratios and faster drawdown recoveries because they rely on invariant structures.

The Structural Revolution in Quantitative Finance