Scott Robinson failed to convert a penalty in added time as East Fife missed the chance to go third with a 1-0 defeat to Albion.
Home goalkeeper Ross Stewart was in top form throughout and stayed firm to deny Robinson after Jamie Insall was brought down inside the area.
Albion had taken the lead 10 minutes after half-time, as Ryan Wallace capitalised on a mistake from Jason Kerr before finishing into an open goal.
Chris Duggan was wasteful in front of goal while Alex Cooper and Robinson saw efforts saved before the latter's dramatic late penalty.
The win moves the home side into seventh in the table, while East Fife remain fourth.
League One News
Stenhousemuir fend off Peterhead threat to clinch promotion
Stenhousemuir take control of play-off final against Peterhead
Peterhead to face Stenhousemuir in League One play-off final
Peterhead edge Stirling at Forthbank Stadium
Alloa dent Ayr's title hopes with home victory
Ayr stay top after comfortable win at Stranraer