Hike #14, 52 Hike Challenge: Fort Zachary Taylor Historic State Park. We hiked around a few of the trails for a great view of Fort Zachary Taylor, a National Historic Landmark that was named after President Zachary Taylor (1784-1850) and constructed in the mid-1850s. The fort was occupied by Union forces throughout the Civil War. Key West is not known for its great beaches, but Fort Zachary Taylor Historic State Park is by far the best of the bunch. You can even grab an ice-cold beer at the onsite Cayo Hueso Cafe! Distance: 1.2 miles.