Klinsmann, who guided the selection of Germany's World Cup in 2006, was told by team officials that his dismissal came into effect immediately.
The club announced that the coach Jupp Heynckes would arrange the equipment to be interim until the end of the season.
The fate of the helmsman of 44 years old, was cast by the poor recent results, including a defeat to win 4-0 to Barcelona in the quarterfinals of the Champions League on April 8.
That pressure became unsustainable after the Bayern 1-0 on Saturday succumb to Schalke, which left the reigning champion in third place in the rankings of the Bundesliga. Revalidate the national title is the only thing it serves to save the season for Bayern.
Assistants Klinsmann, Martin Vasquez and the Mexican Nich Theslof, also left the team.
"This has been a very difficult decision to make, said the club president, Karl-Heinz Rummenigge.
But the results of recent weeks were the way and, above all, being five dates for the end of the season, we were forced to take responsibility for the club, "he added.
Rummenigge said that for now, the team is not on the table the name of a technician to assume the post on a permanent basis.
Klinsmann earned his reputation as a coach to renew the national team, which took home the third place in the World 2006. Under his baton, the picture was characterized by a German attack game.
Your position at Bayern, the most victorious team in Germany and who signed for two seasons, was his first in front of a club.
But was never able to meet the high expectations after replacing Ottmar Hitzfeld, who last year led to the double of league and tournament crown.
The Bayern game was marked by its monotony, particularly after the winter break.
The news of the dismissal caught by surprise to Klinsmann, who perhaps believed that the defeat of the leader on Sunday, Wolfsburg had delayed the decision of dismissal.
"Of course I'm very disappointed at this time," said Klinsmann, who thanked the club, fans and employees for a cycle memorable.
Klinsmann did not want to refer to his future plans. When I took charge of Bayern, he left his residence in California to return to Germany.