Founded in 1854, the First Presbyterian Church of Stamford is well-known in the city for its unique structure, which was built in 1954 and has earned Church landmark status. Known as "the Fish Church," First Presbyterian's building is shaped like a fish and features beautiful stained glass windows and a 32-foot high wooden cross placed in front. The church offers a worship service on Sunday as well as Sunday School, and is known for hosting several missionary trips throughout the year to New Orleans.

The church also runs a nursery school for children, ages three to five. Classes are held in the church's education area and children are educated in various areas of study, including music, science, reading and art.