They started in Bundesliga 2 due to Munich 1860 finishing higher in the year leading into the new league structure (top league only wanted 1 team per city for year 1). Bayern gained promotion to the top league in 65/66 and has never been relegated.
That said, Hamburg is the only club to play in every season of the Bundesliga.