...in all your dwellings...Israel NEVER went to tabernacle, Temple, or synagogue on the 7th day...until after they returned from captivity...you are correct in that for Israel, according to their covenant (not made with their fathers, not commanded in the New Covenant), it was to be a Holy Convocation but in (where) all (plural) their (personal) dwellings (plural, houses)...
Exodus 16:29 "...let no man go out from his place on the Sabbath."
Wake up sleeper...this custom was invented by men while in captivity...it is NOT Torah!
I need to keep this quite short. Please do not take that as unfriendly; that is not my need or intention. I am going to have to do this on the fly, too, because I have never before needed to answer this question.
I think that we sometimes think of Tabernacle, Temple, and synagogue all like "church." First, we all know, I am sure, that there were no places for people to go to services in the Tabernacle -- right? And God's instructions for the Temple did not include a place for "services" as we think of them today either. Certainly, Herod's temple had places in it where people gathered to be taught and to debate Scripture and how to carry out The Words and their explanations. (Remember when Moses went into the tent of meeting? The people would stand in the doors of their tents, watching.)
It is clear that the priests work in the Temple represented the people, as though they were there themselves. It was the people who came to the Temple to provide the beasts for sacrifice and for the priests and people to eat, and they provided the meal offerings and all. The farmers also brought the tithe for the big picnics.
Regardless, the people were commanded to gather for sacred assemblies [Leviticus 23:1-3]. Note that Shabbat is an "appointed feast" and a "sacred assembly." A sacred assembly never needed a designated place other than the home; then, when the gatherings outgrew the homes, they took it outside or to a larger place. Synagogues were, of course, thought of when the people thought they were needed.
One thing that also may have been forgotten is that as the families grew, it would not be normal among them for the men to leave their families. Rather, they brought their brides home, and the bride joined the family. As they had children, or as wealth allowed, they generally added to the existing structures, thus the growth that caused many to seek another place to assemble for the Sabbaths.
The religious people of Israel were interested in searching the Scriptures, in order to find the best way to do The Words and to carry out the instructions. They gathered to debate how to do this on chosen days and times, but also mainly on the Shabbat, in order to fulfill The Words and their explanations.
Observing Sabbath is the sign of the covenant G-d made with the people, to remind them that they had once been slaves, but they had been freed [Deuteronomy 12:11-14]. A gathering, as commanded in Leviticus 23:1, was a holy convocation, and holy convocations usually included discussions about The Words, thanksgiving, and lots of food, as they still do today.
Of course, there are many Sabbaths that are not weekly Sabbaths. The Writings define more specifically what is to be done on a Shabbat in the writings about these Sabbaths.
This was probably rambling, but it tells the intention of G-d's Sabbaths, at least to cover the issues brought up here, I hope.