You need to compress the ejector while you drive in the pin. The pins can be a little tight. Make sure that the ejector is correctly turned so that the groove will allow the roll pin to go past it. I usually use a starting punch to start it, then use a finishing nail punch to drive it most of the way down to keep the pin from peening then use my starting punch to finish it off.