Contractors started to pull down the structure about 9:35 a.m. Sunday — but only half the building collapsed amid billowing clouds of soot-gray dust.