If you're married with kids, a job, a lawn to mow and a dog or two to walk, you probably won't have the appropriate conditions to seriously cultivate merit and yogic attainments. The same can be said for living in a noisy monastery and having many tasks, too. This is why the bodhisattva is encouraged to abandon society and even monastic environments to cultivate him/herself. Having a mundane life is contrary to the path. That doesn't mean practice won't be highly beneficial, but realistically it has many limits.
Maybe a tangent, but I think it's worth bringing up here and it's somewhat related.
The fact is that for many people who are 'householders' today life has more
opportunity for Dharma practice than it would have back in the day. Basic necessities are taken care of, and information on Dharma is widely available FOR FREE and is simply out there for the digesting. Things like mowing a lawn or walking a dog do not prevent Dharma practice at all. For most people who are householders what seems to prevent Dharma practice the most are things like career ambition, overly active social lives, material accumulation, action based on competitiveness, opportunity for quarrels and similar, not just plain family obligation or chores. There is nothing at all preventing people from simplifying much of this stuff - providing they have income
..sad as that is. It is easier today to live in the middle of Western society and still be removed from it than ever before if you have the means, certainly it cannot be said to be any harder than just getting up and physically leaving.
Alot of people ask why Dharma in the west is the domain of certain income brackets - answer is obvious, time and money..ironically an abundance of time, and having enough money to secure that time allow one to practice Dharma more easily in western culture. Not saying it's right, but it is to me a fairly obvious truth. If one has to no longer worry about 'the basics' one has more time for Dharma.
So to relate it to sex, there is no more preventing a person living in the suburbs from cultivating sexual restraint than a monk, Sure it might require him to ditch his TV, stop engaging in certain habits etc. But the monk has to do that also, just in a more formal way so beyond actual vows of celibacy etc., I think the limits you are placing on how well householders can practice Dharma are incorrect.
If the sex thing is really a function of just "overly permissive" liberal western sexual culture (which I think is an oversimplification maybe, possibly tending towards the opposite extreme), then what is required is just non-participation in that culture, that can come from leaving society altogether, or simply not participating in it, and laying down those aspects of our culture - that is something that is done with someone's heart, and might not always be connected with whether or not they physically leave society.
See it as a bubble, see it as a mirage: one who regards the world this way the King of Death doesn't see.