How do I know if my trading model is overfit?

Compare performance on data the model never touched during fitting or tuning, ideally across several walk-forward periods. A steep drop from in-sample to out-of-sample results, or performance that varies wildly across periods, points to overfitting. A single good holdout result is weak evidence either way.

Is a complex model always more overfit than a simple one?

Not automatically; regularized complex models can generalize better than badly specified simple ones. But complexity raises the ceiling on how badly things can go, and on small noisy financial datasets simpler models fail more gracefully.

Can more data fix overfitting?

It helps, but markets limit the cure. Older data comes from different regimes, so extending history adds observations that may no longer be representative. More data reduces variance; it does not resolve drift in the underlying process.

Is optimizing indicator parameters also overfitting?

It can be. Tuning a lookback until the backtest peaks is the same statistical act as tuning model weights. The safeguards are identical: out-of-sample testing, stability across parameter neighborhoods, and honesty about how many variants were tried.

Concept

Model Overfitting

Model Overfitting is a Machine Learning concept. A reference entry: the Library explains it rather than implements it.

What is model overfitting?

Model overfitting occurs when a model learns the noise in its training data rather than the repeatable structure, so it scores well on the data it was fitted to and poorly on anything new. Every flexible model does this to some degree; the question is how much. In machine learning terms it is the variance side of the bias-variance tradeoff: more parameters, deeper trees, or more features let a model track the training set ever more closely while its out-of-sample error rises.

Financial data makes overfitting unusually easy and unusually expensive. The signal-to-noise ratio of returns is very low, histories are short relative to the number of plausible features, observations are autocorrelated so the effective sample size is smaller than it looks, and the underlying process drifts over time. A model that fits one regime tightly can be worse than useless in the next. The same failure appears outside machine learning whenever a strategy's parameters are tuned until the backtest looks good, which is why overfitting and curve-fitting are largely the same disease.

The defenses are structural rather than heroic: honest train/validation discipline, fewer and better inputs via feature selection, regularization and early stopping during training, and skepticism proportional to how many variants were tried. Formal tools such as the probability of backtest overfitting and the deflated Sharpe ratio exist precisely because the intuitive checks are so easy to fool.

How traders use it

Diagnosing with a train/test gap: a large spread between training accuracy and held-out accuracy is the classic symptom; a model that is near-perfect in sample and near-chance out of sample has memorized, not learned.
Controlling capacity: limiting tree depth, adding L1/L2 penalties, dropout in neural networks, and early stopping all trade a little training fit for better generalization; on market data practitioners typically err toward the simpler end.
Counting the trials: overfitting is not only inside one model; testing fifty configurations and keeping the best overfits the selection process itself, which is what multiple testing correction addresses.
Checking parameter neighborhoods: a result that collapses when a parameter shifts slightly was likely fitted to noise, so parameter stability checks are a cheap first screen.
Accepting the residual risk: no procedure eliminates overfitting; position sizing and expectations should assume live performance will be worse than the backtest, often substantially.