Ideas on how to implement

Follow the full discussion on Reddit.
I have a question: I've created and trained a CNN on a dataset consisting of people "with mask" and "without mask". So far so good, now the question is how do i use my already trained model on a new dataset "incorrect mask usage" and only this dataset. I'm getting very low accuracy because the trained model identifies the mask.