Having a proper ping display would be nice, but was suggested a long time ago, so it can't be that simple.
So, as an interim measure, how about just having a link with a steam connect url for the server ? The server has a password and the url doesn't, so this will bring up the steam server-info/connect/password panel. Which has a ping on it.