Not sure if you're already doing this, but since you didn't mention it explicitly and it can help you get rid of a lot of gear: be way more picky about weapons/helmet/shields than you are about gloves/chest/boots. Since their main stat is fixed, you will get a much higher ratio of useful gear for those, and thus can safely toss much more of it. For example, I keep some rare gloves/chest/boots if they have good substats, but I sell any weapon/helmet/shield that isn't at least 5* lego or 6* epic without even looking at it.
I also try to be way more selective about more niche main stats on gloves/chest/boots. Atk% gloves for example is not very useful in general, so I generally only keep the very best of those. Same with res/acc chests; I simply don't use them often enough that keeping a big reserve of them makes sense. Non-speed boots and to some extent also atk% chest also tends to get tossed quite often.
For gear sets; I'm more generous with sets I can't easily replace, like relentless. Sets that are made redundant by other sets, such as life to immortal, offense to cruel, accuracy to perception (and to a large extent also life/defense to resilience) I'm way more picky about, likewise with sets that have questionable effects such as provoke, destroy, frenzy, cursed, curing and fury. Frost, daze and immunity also tends to fall under sets that I just don't seem to use very often (though maybe daze will become more relevant with the new artifact ascension dungeon). Also perception and especially resilience, which I can forge hundreds of at a time anyway (currently sitting on enough material for 734 resilience and 1000 perception 5-6*).
That being said, I'm having issues with my gear storage too and apparently need to get way more picky than I already am. Plarium keeps adding more sets for me to save artifacts for (assuming I actually want to use the set bonus), and new content which makes me scared about dumping all my frost gear just in case they suddenly add a boss that must be frozen to be beat etc.