Looks like I need to look into the rental car now and plan to get to Peggy's Cove 1st. That should allow all the rest of the time to take the FRED in and around Halifax for the remainder of the day. No worries about missing the boat then.
DH and I are usually in the last group to board in ports (never late, but at the five minutes or so).
Thanks again for the help.