Elmwood Park is an open park-like area in the middle of Main Street in the center of Danbury. It is an elongated diamond shape divided just south of its center by Wooster Street which crosses the park from east to west. It is surrounded by granite curbs. Just north of Wooster Street is a large seasonal flower bed and behind it (to the north) is the town historical marker. A concrete walkway crosses the park from east to west just north of the town sign. This section of the park north of Wooster Street is heavily shaded by maple trees and several evergreen trees. At the northernmost end are shrubs and seasonal flowers surrounding three metal poles from which are suspended festive "City of Danbury" banners

South of Wooster Street the park is more open. Near Wooster Street is a seasonal flower bed smaller than the one north of Wooster Street. Just south of this bed facing Wooster Street is a monument remembering the British invasion in 1777. A portion of the text on the monument reads "The Revolutionary Village which centered about this green with its store of supplies for the army was sacked and burned by a force of two thousand British, April 26, 1777."

The park is located in a dense urban area that for two and one-half centuries was the cultural, commercial and governmental center of town. Today those activities are centered primarily in the blocks just north of Elmwood Park, but it has been preserved as an important extension of those activities. On both sides of the street are institutional buildings including the courthouse (1899), St. Peter's Roman Catholic Church and three large buildings associated with it, and the Old Jail (1872; converted to a senior center and located on the site of two earlier jails). These are all large scale, masonry buildings lending the green an air of importance. However, there is a commercial block of buildings constructed in the early part of the 20th century located on the east side of the park at the north end in deteriorated condition that counteracts the effect of the more substantial and better maintained buildings. Another commercial building worth noting facing the park is a car dealership with an Art Deco façade (converted to offices) ushering in the 20th century and the resulting large paved parking lot on the east side across from the Wooster Street intersection.