Castle Rock Beach can be found a short walk down from the Manly-to-Spit walking track, near Ogilvy Road. This small, secluded beach is a great spot for those wanting a quieter day at the beach, instead of the more popular and larger beaches in the area.