Born free, Wormley opened a catering service before the Civil War. As an embassy steward in 1868, he cooked in England for the US Minister to Great Britain. His popular restaurant and hotel catered to politicians and were noted for the menu and well-appointed rooms.