The holes, which are mostly fairly large, and not in rows, are from a boring sponge.
This is a piece of the shell of mollusk, a large gastropod I think, but so degraded that it is hard to guess which species.
The reddish dots are Homotrema rubra, a colonial foraminifera.