Hi nix,
i don't know that walk into Abotsbury but it woulds wonderful, will definitely be trying that one out soon.
There is another good walk from Rempstone up to Nine barrows down (stunning views), if you keep going down the hill after passing the last barrow it will lead you eventually into Corfe villiage. You will see the castle quite early on, basically just head for that.