DNS cache for proxying to remote server?

Created by: Rush

While I am primarily doing proxying to localhost servers I have experimented today with proxying to a remote server and it seems DNS query is being done on every request substantially increasing the request time. Should I query the IP from DNS manually or is there a cleaner way?