โฐ Accuracy by Time of Day

When is the forecast worth looking at? All times 24h, Pacific. โ€” Shoreline Lake thermal predictor. โ† back to forecast ยท model history ยท stats for nerds

โ˜• The short answer

The call from the evening before (~18:00) already carries almost all the skill. The 06:00 morning update (first weather-balloon data) is the peak. Later morning observations barely move it.

So: check once the evening before to plan your day, glance again with the first coffee. After ~13:00 you can just watch SFO โ€” the sea breeze arrives there 1โ€“3 hours before Shoreline.

๐Ÿงช Backtest: 530 held-out days, 2024โ€“2026

Each rung uses only information available at that hour. Bars: Brier skill vs. the "always windy" baseline (threshold-free).

๐ŸŒ™ Day before, ~18:00
45%
๐ŸŽˆ 06:00 morning
47%
๐ŸŒซ๏ธ 08:00 morning
45%
โ˜€๏ธ 11:30 late morning
46%
Forecast as ofAccuracyP(good)R(good)Brier โ†“
Day before ~18:00 (Tmax + cloud forecast, persistence)83%89%89%0.121
06:00 morning (+ 850 hPa profile, inversion)84%91%89%0.117
08:00 morning (+ pressure gradients, buoy, coastal clouds)83%91%88%0.120
11:30 (+ burn-off status, SFO onset, 11:00 temps)83%90%88%0.119

Threshold 0.5; at the operating threshold 0.4 the full model reaches 85%. Caveat: the evening rung uses ERA5/observed values as a stand-in for perfect forecasts, so its real-world numbers will sit a notch lower โ€” exactly what the live scoring below is measuring.

๐Ÿคท Why so flat?

The thermal is decided by the day type โ€” heat demand in the valley, cold-air supply at the coast, interference aloft โ€” and the day type is already visible in the forecasts the evening before. The morning observations mostly confirm what the models already said. The one real addition is the 04:00 weather balloon (inversion + wind aloft), which is why 06:00 is the sweet spot.

๐ŸŽฏ Live scoring (running since 2026-07-14)

Every evening at 19:15 the day's forecasts are scored against what Moffett Field actually reported. This table compares the first run of the day (~06:15) with the last (~13:30) โ€” on real forecasts, no hindsight.

Collecting data โ€” check back in a few weeks.