Swingers festival takes over sleepy small town