Re-enable test_device_maps_gpu (pytorch#56415)

Summary:
Pull Request resolved: pytorch#56415

closes pytorch#53287

Test Plan: Imported from OSS

Reviewed By: lw

Differential Revision: D27865438

Pulled By: mrshenli

fbshipit-source-id: 3f7fcba8b799966388cc98ffc349cb62f281c367

torch/testing/_internal/distributed/rpc/rpc_test.py

@@ -4881,7 +4881,6 @@ def _gpu_add(x, y):
         else:
             raise ValueError("Wrong device affinity")
 
-    @unittest.skip("Disallow new devices in user-function output tensors. See https://github.com/pytorch/pytorch/issues/54017")
     @skip_if_lt_x_gpu(2)
     def test_device_maps_gpu(self):
         options = self.rpc_backend_options