Combat has a use for daggers only if you keep it in offhand. The difference between a slow and a fast one is neglegible and mostly tied on you correct management of KS.
A dagger as mainhand will only be a dps loss.
Go for the best weapons you have - and heroic dagger is better than a normal fist as ofhand and so on.