The Capitol Hill veteran most recently worked for Sen. Mitt Romney of Utah.
The record label was launched in 1993 to support emerging Colombian talent.
Kaplan, who founded the company in 2013, will cede day to day duties in his new role.
Also this week: Gibson makes it official with its COO, Orienteer finds a new publicist, Hipgnosis parts with another board member and there's a new chief Oscars officer.
Albert, a veteran of Capitol Records and Republic Records, is also a co-founder of ska punk band The Mighty Mighty Bosstones.
The Beatport Group has promoted Matt Gralen to president and Helen Sartory to chief revenue officer.
"Joe’s level of dedication to Columbia’s artists is infectious," label president Jen Mallory said in a statement.
Mitch Graham will continue to run unscripted as executive vp of alternative.
Also this week: a former New York Phil-er joins Wise Music Group's Schirmer Theatrical and AWAL promotes a pair.
The executive previously served as vp/assistant GM of back of house operations.
