A development team has broken ground on a 56-unit apartment building in Irvington that will serve low- and moderate-income renters and residents with special needs.