Push to Talk

So, I have a bit of a puzzling situation --

I have push-to-talk that works great in DebugEchoMode with
a single client and AutoTransmit set to off

and

AutoTransmit that works great with more than one client (send/receive)
but ignores my push-to-talk.

I understand why AutoTransmit might be overriding any calls
to VoiceRecorder.Transmit(on/off), but I don't understand why I can't
transmit anything without AutoTransmit as soon as I have 2 clients open.

What am I doing wrong?

I'm running PUN 1.69, VOICE 1.3, Unity 5.3.4
(tried switching to 1.72 & 1.4 but that only breaks more things in my code).