Backlog Sacred Ground + Balancing Act not working properly

[elpariah]

In a recent game with ID 887314044, I played Balancing Act and my opponent had Sacred Ground in play. I expected the lands to return but it didn't.

 

[Firedrake]

Just guessing here, but could it be because your opponent chose what to put in the yard, not you ?