Some, like the Gardeners, were once powerful houses that are unfortunately now extinct.
Over the many centuries in Westerosi history, many houses have come and gone. The Game of Thrones is an ongoing battle for most of Westeros, noble houses often wage war against each-other to claim power, lands or justice.
