A new real estate agency has opened a 1,500-square-foot office in Montclair, with an eye toward serving the residential market in northern New Jersey.