you don't really need a sports arena to do sport. Just running in your neighborhood is a sport and you can do that with your family.
if you live in the apartment, usually they have swimming pool or small gym that'll be a good start.
Right time, people and place?
it's just an excuse.... time is always there, depends on whether you want to use it or not.
that's just my opinion though