It depends on how comfortable you are with a Unix shell, I suspect. If you’re okay dorking around with such things, I’d suggest a cheap VPS host like Digital Ocean, where plans start as low as $5 a month – choose the LAMP or LEMP “droplet” when you initialize your server and it’ll be preconfigured with a web server, PHP and a database. (It can also be preinstalled with WordPress, or some other major web service application things.)
If you’re looking for something a little less “bare metal,” I suspect Anubian Host might be a good choice; they’re AnthroAquatic’s host (and thus hosting these forums currently), and are run by furries. While they have a free site builder stuck in there, I’m pretty sure you can bypass it and upload your own files, either through CPanel or via FTP.