Since you mention it
Just a couple days ago, I spotted a goldfinch on my tall coneflowers. I got a clump from the PA Horticultural Society plant dividend back in 2018 and planted them for the butterflies but apparently the goldfinches love them too.
The earliest blooming ones were done and side shoots were starting to bloom, but these are thick stemmed perennials that are at least 4ft - 5ft or more tall, where the stems stay upright without a support, and could easily support the bird. It was a male who was carefully clinging to the stem plucking at the seed heads and going from flower to flower. Definitely brightened my day! 
The next day he came back but then started fighting with a sparrow. 
I don't normally cut those back for more blooms as they seem to resprout along the stems anyway and they self-seed all over the place, so I'm constantly pulling seedlings out from where they don't belong! 