I would be thankful - the filter is doing its job.
3 possible routes for dust ingress. 1, through the filler/cap. 2, through the breather. 3, contaminated oil or dirty funnel. Eliminate the dust ingress, eliminate the problem.
Sorry if I am stating the obvious, but often it helps to just...