It appears as though the concrete squares, on the sea defence wall, are blocking what were once windows? I can't see whatother purpose these concrete extrusions to the facade serve? The exterior walls of the castle are constructed entirely of flint.
The bay provides some of the largest sea formed chalk caves in the country. One even has an air or light shaft carved through the cliff to the surface. You can really appreciate why bays like these were notorious for smuggling.