I had the same problem, and after tracking down the problem, it turned out that the connector that you plug the fan into was damaged and wasn't holding the cable tightly enough (the fan was getting power, but not the control signal to tell it what speed to run at)

My slightly janky fix was to start the switch with the back off and manually press down on the little connector to get the fan working, and then hot glue the connector in place.