I'm pretty sure that's the case. Channel Times are fixed. Using less magik doesn't affect the time at all, just how often you can use the attack before your magik is empty.
Faster channeling however feels really good for certain weapons. Especially the big axe
