That is possible, but Bandwidth Manager does not support prioritisation as such. You can assign transfer limits to certain IP addresses, but it's not possible to prioritise some IP addresses over others.
If you can plug that server between the router and the rest of the network, you can transparently introduce those limits with a
bridged configuration.