Virtual server 2005 can not ping from clients on the network outside of the host machine?

I am running windows 2003 r2 with virtual server 2005. I have one network on the virtual machine attached to the pyshcial network adapter on the host. The host can ping the VM the VM can ping the host, but clients on the network cant not ping the VM. Any ideas? Thanks.