Rome had around 50-75 million inhabitants at the height of its empire. This occurred in the mid-second century between the reign of Nerva to Marcus Aurelius.
The city of Rome itself was the first city to reach one million people (around 1 AD). After the western empires collapse, the population dropped to 30-100 thousand souls.
Here's a cool website with more detailed explanation -