A novel and memory-friendly preference alignment method for diffusion models that does not depend on any reference model.