Roberts was born in 1777 in Charleston, South Carolina, and moved to Boston where he was head butler to Governor Christopher Gore. In 1827, he wrote The House Servant’s Directory, an essential guide to the profession. He was a fixture in Boston’s abolitionist community.