While investigating twitter, I found a protect my tweets in the Privacy page that you can activate. When activated, only your current followers and people you approve in the future will be able to see your protected tweets. I did not have that activated, but now I do.
Locked
