Luka Milivojevic's first-half penalty was enough to separate the sides at Selhurst Park, as Albion suffered a narrow defeat.