Latency defines the time that is takes for a request to travel from the sender to the receiver and for the receiver to process that request. This is greatly affected by how far away the user is from the server and the quality of the network.
You can never get rid of latency, but the great news is that there are latency optimization guidelines which you can apply to negate some of the delays that occur.
Create a dedicated version for production
Do not enable auto publish for that version and publish manually or via API
Enable Cache-Control max-age