Do Americans notice the differences in British accents?

We do know that there are different British accents but it's a lot harder to distinguish between them for me at least. I think that if I heard them all say the same sentence I'd be able to tell.