A two-story medical office building in Millburn has changed hands for $8.5 million, following a sale arranged by Marcus & Millichap.