This work studies the relationship between the thermodynamic arrow of time (associated with an increase in entropy) and the psychological arrow of time (associated with the existence of memory). The authors argue that the two arrows must necessarily align even for physical memories which are nondissipative and time reversible.