Columbia Bank has opened a new branch in downtown Rutherford, where it occupies some 2,300 square feet that it secured with the help of The Goldstein Group.