Just a little playing around brings great results.
I needed to work with arranging the order of the monitors plugged into the adapter. Once I found the correct order for my particular monitors everything works well. One monitor uses a DVI to HDMI cable others use standard HDMI cables. All cables use an HDMI to Display port adapter.