In British English, we usually talk about the city centre or town centre.
„Let’s meet in the city centre.“

In American English, downtown is common.
„Let’s meet downtown.“

💡 Quick tip:
The meanings often overlap, but downtown can also refer specifically to a city’s central business district.

Both expressions are widely understood internationally.