Man followed into Upper Manhattan building, robbed of $100,000