All these CO3 was derived from small sea creatures with Calcium shells.

When these sea creatures died throughout earth's history (millions of yrs.), their Calcium shells which lasts for a very long time eventually accumulates at the bottom of the sea.

And since the sea is so vast & it contains a gazillion shelled creatures, then ovetime (i.e. millions of yrs.) lots of shells accumulates on the sea floor.