Paying bills on time is generally the single most important contributor to a good credit score. Being late on any bill, for any length of time, is a possible indication of future non-payment of debt and is almost always viewed negatively by lenders. Any late payments will remain on your credit report for up to seven years.