When you want to build a consistent stroke and allow the path of your putter to go back & through, use the towel drill to get your arms more connected to your chest.
Keeping your arms close to your body and your head still will help you to make consistent square contact, eliminating those pushes and pulls.