Presidential library's?

do all ex presidents have library's. going all the way back to the first...whats his name george york?......just kidding,but serious,how far back are the library's,and if i go to george w bush's will i hear david Bowie's "the man who sold the world" playing over and over