If you think it's your router, is there any way you could borrow a router, or directly connect the server to the internet temporarily? (For example, I still have my old USB ADSL modem lying around I'd use if my modem or wifi card screwed up on my main PC)
It'd help narrow it down, if it is your router thats screwing up, they're cheap enough to replace now, but theres no point doing that if it's just Windows setup wrong

Another possible way to narrow things down is to use a linux live-CD, and install the OFP dedicated server on that, and see if you get the same problems
Only other (fairly obvious) thing I can think of is the cabling to the server, but if the LAN client is staying it can't be that..
Other than that, I've no idea
{Edit} The router you have, it has SNMP support, which allows the Multi-router traffic grapher (MRTG) thing to work, if you can be bothered setting it up, it'd show how much data is going though the router at the time, if it suddenly dips (with no LAN client) it might be your internet connection screwing up and causing the clients to lose connections.. Though it's kind of unlikely, as it's only with OFP (which could mean it's more likely a game/server problem)
{Edit2} Kind of obvious, but the router has been rebooted recently? They screw up sometimes, but I seriously doubt it would be that regular..
- Ben