Make 100% sure you have all the + speaker wires going to the + speaker terminals, and all the - speaker wires going to the - terminals. Swapping one of them will cause what you're describing.