You shouldn't need portal to have the textures if I'm correct. I don't have it installed and I got the textures.
If you haven't, try deleting the map from your TF2 folder and then reconnect to the server. It should redownload the map, maybe that will do the trick