The singer recalled how he was "buzzing" to release even one album after leaving One Direction, and now he's on No. 5.