Many of the plants you mention grow equally well here in the middle of the southern tier of the Midwest with two notable exceptions. Columbine grows well further north but struggles here and sometimes goes dormant or just dies out in the summer heat and Persian lilacs seem to survive the heat and humidity best here. However I would add to the list of hardy, relatively care-free, all season bloomers for those of us living a bit further south the crepe myrtle, perennial lantana, guara, Russian sage, Knock Out roses, four o'clocks, cone flower (and other wildflower near natives like coreopsis and gallardia), and purple heart.
I first grew it this as a houseplant further north and then found out it will overwinter here in OKC and farther south. It's easy to propagate by breaking off a stem at a joint and inserting the stem directly into the soil where it is to grow or by rooting a stem in soil less potting mixture. The tops die back in the winter but it comes back from the roots. It is reliably perennial here if planted in full sun but it may well be an annual/houseplant if planted any farther north. I think another common name for it is Moses in the Basket.