Don't polish the ports on the inlet side. Some of us have found that when fuel hits a mirror finish, it turns into beads and dribbles rather than smashing into a rough surface and atomising properly.
Exhaust side is fine to polish if you want... lol.
Run some Holden 202 valve springs - 4K valve springs just cannot handle high revs and you'll be losing easy power there...
You'll also gain more easy power by balancing the internals of a 4K. They really don't like being taken over 9000 RPM very often unless you have balanced them. Mine used to hit 9200'ish a couple of times a week.
But as you mentioned, the head is by far the most restrictive part of a 4K engine. I'm pretty sure that N/A even with massive porting and balancing most of the highest powered 4K engines max out at the 150-160HP (at the fly) range. Forced induction should get you over that (up to 200HP if you do it right). Theres a bloke on Rollaclub who managed to fit a 4AGE twincam head onto a 4KC - Epic swap. HEAPS of induction air flow with less restriction that the crappy K series head, with the instant benefit of quad throttle bodies & EFIwheee...