You may lose a small fraction of the followers in future, because the nature of the social media website is dynamic. However, most of the Twitter users will probably follow you forever.