Torque controllers have become commonplace in the new generation of robots, allowing for complex robot motions involving physical contact with the surroundings in addition to task constraints at Cartesian and joint levels. When learning such skills from demonstrations, one is often required to think in advance about the appropriate task representation (usually either operational or configuration space). We here propose a probabilistic approach for simultaneously learning and synthesizing control commands which take into account task, joint space and force constraints. We treat the problem by considering different torque controllers acting on the robot, whose relevance is learned from demonstrations. This information is used to combine the controllers by exploiting the properties of Gaussian distributions, generating torque commands that satisfy the important features of the task. We validate the approach in two experimental scenarios using 7-DoF torque-controlled manipulators, with tasks requiring the fusion of multiple controllers to be properly executed.