You are right in the sense you absolutely cannot get a deep understanding of Statistics without Calculus.

But with a mere background of high school algebra, you can learn more about Stats than most college graduates have, and that knowledge is far more relevant to the day-to-day lives of the average person in America than Calculus is.