Oh good, I pretty much avoid it like the plague anyways.
While Skillspeed isn't weighted as heavily as Det and Crit, you may not have any options as you're gearing up to get some. I don't really agree with having base skill speed. Attacking more > attacking less, but the tricky part is figuring out how much skill speed to carry with you before it becomes a burden.
Basically, don't worry about your skill speed stat until it becomes a problem. Just let it happen and deal with it. So much BRD stuff carries it these days it's impossible to avoid it.