The first Labor Day holiday was celebrated on Tuesday, September 5, 1882, in New York City. Source: The Department of Labor