The Ashford Town Green is a large square-shaped lot of about ten acres partially planted with grass and random trees and partially covered with dense, scrubby woods. It fronts Route 44 on the south, a busy state highway, and is divided by Fitts Road, a dirt road. It diagonally enters the green at the southeast corner then curves north to divide it into two parts. A stone fence marks part of the western boundary and there is a remnant along the lower part of the eastern border of the green. The land slopes rather steeply from the north where the Babcock Cemetery is located to the southeast corner.

The green appears much smaller than the original ten acres allotted because the dense wooded portion covers most of the site to the west of Fitts Road and a good portion to the east of it, or about two-thirds of the green. Just the central portion is kept open and mowed where a few deciduous trees have been planted including sugar maple, ash, elm and oak trees.

The only building on the site is the Ashford Academy (c. 1829), a two-story structure in the Greek Revival style. The academy together with its original outhouse are listed on the National Register of Historic Places. The second story was paid for by private subscription and added on to a schoolhouse that was in the planning stages in order to provide a place to reach more advanced students. It was built at a time when the green was bustling with activity and remained in use as a district school until 1949, long after the green ceased being the town center.

To the west of the academy is the Babcock Band Gazebo, originally located in Warrenville. According to local tradition, the Babcock Band is the oldest continuously-meeting band in the United States and it held the last concert at the Gazebo in 1976. Today the gazebo is in serious need of paint and repairs.

The buildings near the green along Route 44 give little hint of the historic nature of the space. The most visible structures are a fast foods "Dari Bar" and a car sales lot across the street. There are two early buildings to the east of the green, one once used as a post office. To the north of the green along Fitts Road and not visible from Route 44 are several houses from the last half of the 19th century.

The wooded portion of the green with the dense undergrowth, along with the deteriorated condition of the gazebo and the borderline nature of the businesses across from it make it appear rather deserted. It is hard to imagine it was once the center of a thriving community.