John DeFrancis reader series (Beginning Chinese Reader, Intermediate Chinese Reader Part I, etc) from Yale University, from the 60s, are full of Chinese, but have pinyin to give pronunciation in the vocabulary sections.
I also thought they were fabulous, because he used spaced repetition, and started with easy structures and words.