Jack Murphy's kicking helped bring Ulster back to within five points late on, but Edinburgh held out to take the win.
Ulster have opened their URC campaign with a 34-29 defeat to Edinburgh in Belfast.
The home side found themselves 34-5 down early in the second half before mounting a strong comeback through tries from Zac Ward, David McCann and Keynan Knox.
Jack Murphy's kicking helped bring Ulster back to within five points late on, but Edinburgh held out to take the win.
Ulster do at least leave with two bonus points from the defeat.

Irish Boxing Team Arrive Home After Winning Medals At European Championships
Connacht Beaten By Late Stormers Surge In URC Opener
France, Belgium, And Sweden Pick Up Nations League Wins
Saturday Morning Sports News
Manchester City Reportedly Found Guilty On Almost All 115 Charges Of Breaking Premier League's Financial Rules
Aoife Wafer Ruled Out Of Ireland's Second WXV Match Against Japan
Full Field Of 30 Set For €500,000 Irish Cesarewitch At The Curragh
Premier League, La Liga, Serie A, And Bundesliga State FIFA Is "Not Fit For Purpose"