I recently learned about Module::Starter and used it to build a skeleton for a web app (assortment of CGI scripts along with associated modules). Being able to test my code by running make test is great, but I'd also like to test the CGI scripts with something like Test::WWW::Mechanize. This would require installing the scripts somewhere and configuring a webserver before running the tests, which seems kind of bassackwards.
Does it even make sense to include tests like this in a distribution? My sense is that I should make my modules do as much of the heavy lifting as possible and have the CGI scripts simply call module functions, but one of my main reasons for testing is avoiding security-related regressions in my CGIs.