VLAN tagging in Solaris

If you want to have zones in multiple subnets but using the same physical port, you have to use VLAN tagging. VLAN tagging is pretty easy to configure on the zones (point 7), less so on the global zone.

1. The Network guys have to do a few things for you:
• set the network ports your nic connects to as "trunked"
• give you the vlan id of the vlans you want to connect to (digits)
• for aggregated NICs, set LACP to active (rather than auto)
• set the default vlan-id of the ports to 1 
2. NOTE: Configuring the ports as trunked, obsoletes any traffic that isn't vlan tagged. All or nothing baby. 
3. Your aggregate needs LACP activity to be active
• dladm modify-aggr -L active -T short aggr0
4. I use aggregates, but I think most of the same steps below applies for IPMP.
5. I wish you could add a default vlan ID to the aggregate when you create it but you can't (and I get the feeling if I think really hard about it, I'll be able to see the logic in why). Instead you have to create a vnic on the aggregate that uses that vlan ID:
• dladm create-vnic -v 10 -l aggr0 vnic10
6. Now create an address on that vnic
• ipadm create-ip vnic10
• ipadm create-addr -T static -a 196.0.10.15/24 vnic10
7. That sorts out the global zone. For the zones its pretty easy. Just set the vlan-id attribute (under anet) on the zone config.

NOTES:

• The active LACP is not something I'm sure needs to be there but it worked so I'm leaving it.
• IPMP in zones - if I recall correctly - needs vnics created for you to do IPMP within the zone. Just make sure you assign the correct vlan ID to those vnics and you should be fine.