The plants listed above do not need to be replanted each year, they can freeze hard in the bog during the winter and come back each year. Look for water plants that are zoned for your area or colder. I would also recommend the following plants for your bog:
Marsh Marigold, hardy to zone 2, very very hardy and blooms very early in spring, then dies back like a panzy in summer, but gives you nice flowers for Easter.
Gray Sedge, if you can find one, hardy from zone 3 to 7, this plant resembles an umbrella palm but offers hardiness of tropical appearance for northern climates. Still keeping my eye out for one....
You might get away with a water bamboo, hardy from zone 6 to 11, would be nice to try and see! Water bamboo not really a member of the Bamboo family, but looks like bamboo and may work for you in zone 5. Could be risky, may not survive very hard winter.
Cotton grass is zoned 6 to 11, but I have had one for 20 years now, and I am in zone 2/3 and it comes back each year, although my pond does not freeze solid with the heater. I think it work for you too and it is easy to find in any greenhouse usually.
Rose mallow or swamp hibiscus, zone 5 to 11, should work nice and give you nice red flowers most of the summer. Grows 4 to 8 feet. Seeds may also be sown in late spring in shallow area of bog.
Water pennywort, zone 5 to 11, could also be nice, these plants are rapid growers that move quickly across the bog and are easy to remove is you get too much. This charming plant has worked well for me in the past, but I now longer have it as I think I got tired of it 12 years ago....
Water clover is zoned 6 to 11, never had this one, but one day I think I am going to try it lucky 4 clover charms! It likes shallow water, and does not root deep so it can be easy to thin out. May not surive hard winter.
Bog Bean, never tired, but zoned 5 to 11 and have heard good things about this scrambling plant, could be slow to establish though....
Pickerel weed will work good for you, leave and freeze zone 4 to 11. Grows to up to 24 inches, have had it years ago, very hardy, nice purple flower too.
Woolgrass bull rush, not a rush, it is a grass. Zone 3 to 11 and very very hardy, will come back each year, leave and freeze. Grows in clumps up to 3 feet with wooly spikes on top.
The list of possiblities are endless, you will just have to search your local greenhouses in the spring to see what is available, Like I said too, any cat-tails will be hardy, and there are many types to choose from these days. Rushes are also very very hardy as is my very favorite sedge, the Yellow Flag Iris, should see them growing naturally in some areas of Ontario too, you could just dig out a clump if you see some, free plants are always great!
Hope this was of some help, feel free to ask me lots of questions too!