The Coe Memorial Park, located within the downtown Torrington Historic District (and just outside the local historic district), is just south of Center Bridge which crosses the West Branch of the Naugatuck River. Just north of the river, four streets fan out, serving as the city's commercial hub. Historically, this area was known as Center Square. Coe Park is a large triangular park at the fringe of this historic center. It is bounded by Litchfield Street on the west and South Main Street (Route 202) on the east.

Coe Park is surrounded by Residential and Commercial Development dating from the 19th and 20th centuries. Because the park was created in the midst of previous development, there is little continuity in the surrounding streetscapes. Litchfield Street to the west is lined with good-sized buildings evenly set back from the street that provide a substantial enclosure for that side of the park. They consist of institutional, commercial and civic buildings. Some are converted residences. Across South Main Street, the eastern border of the park, is a contemporary shopping center well set back on an asphalt parking lot. It leaves the east side exposed to the traffic it generates. A large contemporary bank abuts Coe Park to the south. It is next to a substantial nineteenth century neighborhood laid out on fairly long and narrow lots. Carriage houses of two of the residences are situated close to the park's boundary.

Benches along both Litchfield and Main Street are shaded by a variety of trees. The park is crossed by a number of winding walkways; some are asphalt, some concrete, and some crushed stone. A chain-link fence borders the rear of the park. Near Litchfield Street at the rear of the park is a parking lot paved with crushed stone. A victorian carriage house stands at the edge of the parking lot.

Five monuments are located on the park grounds. At the point of the Litchfield and Main Streets is a Civil War Monument, a base drum upon which a union soldier stands holding a musket. Three more monuments are located in a diagonal line into the park several feet apart. The second monument is a 15-ton boulder with the Coe Memorial Plaque mounted upon it. The third monument was donated by Major William E. Besse of the National Guard to the Second Regiment. The fourth, and by far the largest monument, is a war memorial with plaques listing veterans of the Civil War, Korean War, World War II, the Spanish-American War and the John Cavalari Post of Italian-American War Veterans. The broad platform base of the monument is octagonal and surrounded by flower beds. The fifth monument is in front of Park Center. It is a contemporary stone water sculpture designed by the artist Edward Monti and dedicated to veterans of the Vietnam era.

There are decorative lights mounted on posts along walkways in the park and spotlights light the large war monument and the Edward Monti sculpture. The broad concrete platform which forms the entrance to Park Center is covered with a ceiling rigged with mounts for stage lighting and backdrops so that the platform can be used as a stage for outdoor concerts and performances.