Glossary
Base rate
How often an outcome occurs in general, before any signal is considered. A signal is judged by how its results differ from the base rate.
A base rate is the unconditional frequency or average: the share of days that are up, or the average return over any 5-day window. A signal carries information only if the outcomes after it differ from the base rate by more than chance.
Ignoring it makes any signal look good in a rising market.
Example: 5-day windows are up 53% of the time. A signal followed by 58 up windows out of 100 has a standard error of 4.99% against that base rate, so z is 1.0 and the p-value is 31.6%. It is not distinguishable from chance.