I simply don't understand why the universe would not be homogeneous anyway without inflation.
When cosmologists discuss inflation, homogeneity is always mentioned in addition to the other evidence for inflation. You said, "Inflation removes whatever inhomogeneities were there in the initial state." But, if the initial state was a singularity, would it not be completely homogeneous anyway? How could a singularity be inhomogeneous? I guess that's my problem. What am I missing?
Singularities are often wildly
inhomogeneous. Here's a mathematical example (I'll give a physics one below). Take the function f(z)=e
-1/z. That function has an essential singularity at z=0. One fact about it is that as one approaches the origin of the complex plane z=0 from different directions, f takes every finite value (except 0) an infinite number of times. In other words, it oscillates more and more wildly the closer one comes to the origin, even though it's just a single point in a plane.
The big bang theory states that at one time, all points in the universe were at zero distance from each other. In other words, in contact.
No, it doesn't. In an infinite universe, the only sensible definition of the volume of the singularity (which is the limit of the volume as t->0) is
infinity. In a finite universe it's true that the volume goes to zero at t=0 - but what's more relevant here is the distance d between two points at time t, divided by t - i.e. d/t. If that ratio is greater than c it means light hasn't had time to propagate between those two points since the bang. But it turns out that d/t>c for all points as t->0 (except in certain special cases). So in the early universe
no pair of points can have had any contact at all until some time after the bang - and without inflation that still hasn't happened to the pair of points we're looking at when we look in opposite directions on the cosmic microwave background sky.
I have never seen any reason to expect that distant parts of the universe wouldn't or shouldn't be homogenous.
Well, again, run the universe back, starting from the initial conditions today. What you'll find is an infinitely inhomogeneous solution (that's the physics example). You can imagine starting with some wiggly function, and then shrinking the scale of the x axis at the same time as you increase the amplitude. The function gets infinitely spiky - it has infinite derivative at every point. But in our universe without inflation it will be an incredibly special kind of spikyness, very carefully tuned so running forward again, by the time that would correspond to the end of inflation those spikes have moved around and combined with each other to form thermal equlibrium (which remember is a
much stronger statement than mere homogeneity) to an incredibly perfect degree, but leaving behind in addition an almost precisely scale-invariant spectrum of very small (1 part in 100,000) fluctuations over a huge range of length scales. It's not
impossible - but it's the kind of thing that no one would ever believe is a coincidence.