Perhaps, but you can use opponent targeting effects like Duress on yourself and successfully take your own cards, so I don't see how this is any different. Someone else tried this out 1v1 and it didn't work for them, I just tried it solitaire and figured it should still exile it.