Do I need extra server infrastructure to host and use QlikMaps?

No. The only impact on your QlikView environment is for web server to serve up the QlikMaps extension to the AJAX client the first time it is requested. This is a <100kb hit, which is insignificant compared to all of the other processing the QlikView server and web servers perform.