Businesses should keep a variety of receipts, including those for operational expenses like supplies and utilities, capital expenditures for assets, and any other costs related to the business. Receipts for employee reimbursements and travel expenses should also be maintained. Each type of receipt can play a vital role in both financial planning and tax compliance.