The 2 center pads are really the only ones you need worry about, as they are the + and - ones, and they look intact. The 2 outside connections are just for mechanical stability of the connector, they have no electrical connection to anything as far as the battery is concerned.
I'd just clean it up, set the connector back on there and solder those 2 leads. Then if you want, a drop or two of super glue on the sides to hold it on there a bit more solid. Then just be more careful with it if you have to unplug the battery.