Blues had appeared to be heading to all three points under caretaker joint managers James Bennett and Jack Corbett after Steve Kirkham's first half goal.
However, after Bennett had a second half penalty saved, Little Common equalised in the second minute of time added on and then got the winner two minutes later.
Bennett said: "After conceding six in both our previous two games, we went there to tighten things up and played 4-5-1."
"We looked to contain them and it worked really well for 90 minutes, until they scored two in stoppage time".
"Everyone was gutted afterwards, but everyone had given everything, so there were positives for us to take, following the first two games."
Rustington led 1-0 at half-time as Kirkham gave them a 36th minute lead when the Common keeper was out of position and Kirkham's early shot crept into the corner.
Blues had chances to extend their lead as Bennett's spot-kick was saved and Kirkham twice went close to a second.
Common levelled with a good Charlie Bachellier finish from the edge of the penalty area in injury time and Adam Smith then snatched a winner for the home side shortly afterwards.
Taken from the Littlehampton Gazette on Thursday 22nd August 2013.
Article from Twitter @Worthing_sport