Linlithgow booked their place in the last 16 of the Scottish Junior Cup and set up a home tie against Camelon or Troon.
Kevin Kelbie drove Rose ahead in the 29th minute and they looked comfortable until the 44th minute when Nicky Gordon equalised with a stunning strike from the edge of the box.
The Linlithgow lead was re-established on the hour when Tommy Coyne was brought down in the box by Kieran Heads and dusted himself down to convert the penalty. There was a further twist in the 81st minute when Rose failed to clear their lines effectively after a short corner and Harry Milne’s cross-come-shot found the corner of the net.
In a frantic finale, Rose secured their passage to the last 16 with a 91st-minute goal as John Ovenstone launched a long throw into the box, and Calum Smith finished from eight yards.
Culter: Reid, McArthur, Milne, Shand, Heads, Presly, McKimmie (Smith 85), S Taylor (Cromar 82), Gordon, M Taylor, Leith.
Linlithgow: Christie, Tyrrell, McKillen, O’Byrne, Ovenstone, Ruari MacLennan (Batchelor 64), Smith, Shirra, Kelbie (Strickland 76), Coyne, Roddy MacLennan (Thom 71).