Select an alliance building on the system map and choose Defend. After sending your fleet, you can choose to recall them from defense duties at any time.