When using the right contract home buyers have a number of opportunites to walk away from their contract to buy a home and even receive their down payment money back. There are other situtations though before closing that if a buyer walks away they could lose more than just their down payment as they could be subject to a lawsuit.