Do You Share Your Pool?

So a friend of mine got a pool this summer and lately he’s had his neighbors walk over by their fence around the pool to make small talk. The people on both sides of my friends house don’t have a pool but they do have lots of screaming kids. Now he says they didn’t come right out and ask if they could take a dip but both my friend and his wife felt like they were fishing for an invite. It’s uncomfortable and my friend isn’t sure how to handle this. He likes his neighbors but they got the pool for his family and he’s afraid if he invites them once, they’ll expect it to be a regular occurrence.