RR4me:
[All the spacers/collars are in place. I'm wondering if I can place an additional spacer/washer on either side of the wheel so that when I tighten the axel nut, it'll leave just enough spacing for the wheel to clear the swingarm?
That's a band-aid repair that will probably work with a very thin spacer but i wouldn't recommend it as your solution

The axle has minimal threads and you'll be creating a non-parallel alignment, just my .02!
The inside machined surfaces of the swing arm, although forgiving, are fabricated to the exact dimension of all the inner brg races and combined spacers/collars when preloaded (tightened/torqued). You can end up coining the inside of the arm by the eccentric load IMO.
Based on your gallery photos i can see that you are running a 240 Dunlop Elite 3 and what looks to be a 8 1/2" weld-up whl which doesn't require much metal removal at all from the inside of the arm because it is a narrower profile tire than the Metzler.
Pull your wheel, get out your right angle grinder or Dremel and remove the metal where the wheel is rubbing. Making clearance for the Elite 3 tire isn't rocket science at all and can be done on the bike. Finish off with a rattle can. Here's a recent Topic: DIY 240 overall cost and here's how it's done with a Metler 240: CLICK HERE or HERE for on the bike