They go steel... Then rubber and finally felt.
So when rebuilding them... Soak the felt in light machine oil and squeeze out excess, slip it over the ball first, then pop over the rubber one. Then the steel. Fit knuckle and king pins.... etc etc. Do the pre load on the swivel bearings and finally fit the seals back against the knuckle.
