Hahaha, ideas around continuous pre-training are now being formalized into teams called "mid-training" https://vintagedata.org/blog/posts/what-is-mid-training