An engaging if slightly esoteric exhibition at the Brooklyn Museum is built around 160 pages from the artist’s notebooks that have never been publicly exhibited before.