There is a small car park adjacent in the Church grounds or park in a nearby street. 
Buses - Stagecoach routes  55, 56, 56E, 151, R1, X15 all stop very close by at the Family Shopper or Moriah Chapel opposite.
Trains - Risca & Pontymister station is a 10 minute walk away on the Cardiff to Ebbw Vale railway.