Simpson-Daniel will start on the wing and Richards at scrum-half, while Brown will be partnered in the second row by James Hudson of Bath. Forrester, who will start at blindside, will be partnered by Michael Lipman and skipper Pat Sanderson on the back row.
The match 22 contains 15 of the squad to tour Australia, six from the England Saxons Barclays Churchill Cup party and England Under-21 back row James Haskell.
London Irish captain Mike Catt, voted Guinness Premiership Player of the Season last night, is back in an England shirt for the first time in two years, alongside Mathew Tait (Newcastle Falcons) in the centre, while 6ft 7ins newcomer James Hudson (Bath Rugby) starts at lock.
"I am excited about the side we have selected," said head coach Andy Robinson. "There is a good blend of experienced internationals such as Iain Balshaw and Mike Catt, as well as guys we are looking to develop through the Churchill Cup like James Hudson and James Forrester.
"Playing a strong Barbarians side will be an ideal test before we go to Australia and the Saxons to Canada and I am confident that, ably led by Pat Sanderson, they can win on Sunday."
Tickets for the Gartmore Challenge are available from Ticketmaster 0870 902 0000 priced £20/£35 for adults and £5/£15 for children.
England: Mark Van Gisbergen (London Wasps); James Simpson-Daniel (Gloucester Rugby), Mathew Tait (Newcastle Falcons), Mike Catt (London Irish), Iain Balshaw (Leeds Tykes); Olly Barkley (Bath Rugby), Peter Richards (Gloucester Rugby); Tim Payne (London Wasps), Lee Mears (Bath Rugby), Duncan Bell (Bath Rugby), James Hudson* (Bath Rugby), Alex Brown (Gloucester Rugby), James Forrester* (Gloucester Rugby), Michael Lipman (Bath Rugby), Pat Sanderson (capt, Worcester Warriors. Reps: David Paice* (London Irish), David Barnes* (Bath Rugby), Kieran Roche* (London Irish), James Haskell (London Wasps), Scott Bemand (Leicester Tigers), Stuart Abbott (London Wasps), Delon Armitage* (London Irish).