Rolin said Sam was isolated and friendless during season 3 shooting. Sam said similar things too.I don't think anyone was staying with him anywhere except maybe that Toronto Film festival time when his gf came to attend that and be with Sam.
Jacob's family being in NOLA during season 1 was already known right? We didn't come to know of it later? He talked about it during initial season 1 press. He appreciated his wife for taking care of their young child even during the start of those interviews.
I didn’t know Rolin said Sam was isolated and friendless lol. What? That sounds horrible. And we know Pip was there at some point , she posted about it.
My point is that it seems Sam and Pip have a second home base in New York. He has referred to it as such in interviews recently when he talked about having a favorite shop to go to in New York too.