What is holystone? What is holystone? A piece of soft sandstone used for scouring the wooden decks of a ship.To scrub or scour with a piece of soft sandstone.