In top of double boiler, combine brown sugar, flour, and salt. Gradually stir in milk. Cook over boiling water until thickened, stirring constantly. Cover and cook 10 minutes longer, stirring occasionally. Add a part of mixture to egg yolks, stirring vigorously; return to mixture in pan and cook 2 minutes longer. Add butter and vanilla; let cool. Place alternate layers of filling and sliced bananas in pastry shell. Chill and cover with
whipped cream topping.