A point is the most fundamental concept and mathematical object in geometry. Just because it is fundamental, doesn’t mean it exists without depth. A point represents a location. It can be 1-dimensional, 2-dimensional or 3-dimensional. In fact, a point can have however many dimensions it needs.
