Yes, people should have a special vote that can be summoned at any time to fire the Prime Minister if Canadians find he's not doing a good job. Only if 70% or more vote in favor of removing the PM would it result in him being forced to step down, but the party is still in charge until the next real election. However, if the PM won his last election by 40% or more of the popular vote, then this vote cannot take place or have effect.