They went out, but they did not go out in a disorganized way. Everybody was not just tramping, tramping, tramping—running things over, or whatever. They were all lined up. And, because of Scriptures like this, I do not believe that Moses merely assembled everybody in one huge mass, like a huge crowd attending a rock concert, in some open area of Rameses. It would not have worked that way. The indication, from these Scriptures, is that he had them lined up as in a parade—according to their tribes, according to their families. It was not a milling mass of people, just running in every direction. Rather, he had them lined up—like a parade.
How many people are we dealing with here? According to Exodus 12:37, 600,000 men who were fighting men (over the age of twenty). If there were 600,000 men, there must have been at least 600,000 women (also over age twenty). According to the United States Census Bureau, the population of the United States right now is 52% female and 48% male. If it was the same in Israel, then we are very conservative by saying that there were an equal number of men and women. Thus, 1,200,000 Israelites (males and females) above the age of twenty.
How many children were there? Exodus 1 says that the Israelites were a prolific bunch, and they had their babies so fast that they had them before the midwife could even get there. Surely there must have been at least one child for every adult. (I think that is very conservative.) So, already we are up to the place where there are 2,400,000 Israelites getting ready to leave Egypt.
I have seen where mathematicians have calculated, given that figure, that it could very easily be between five and six million—given the period of time that the Israelites were in Egypt, the land that they dwelt in, and so forth. But we are going to say a conservative estimate of somewhere around 2 ½ million people.
These verses clearly show that the leaving by night pertained to the first Day of Unleavened Bread—the 15th, not the 14th.
Passover is the 14th, and the starting point. According to verses 2 and 3, it was in Rameses, not their houses. It was the night part of the 15th day of the month that they left Egypt. It was the 15th day of the first month, on the day after the Passover.
The Egyptians would not have been burying their dead just minutes after they died on the 14th in the dead of night. They were burying their dead late on the daylight portion of the 14th toward sunset, as the Israelites were beginning to move out of Rameses. That is four differences already.
Now why would they celebrate all night? They were commemorating coming out of Egypt, and in all likelihood the Israelites, once they began to leave Rameses, did not stop till daylight the next day. They marched all night, and then rested in the heat of the day. They were celebrating "The Night To Be Much Observed"—a night of watching. God was watching over them as they left Egypt by night. Now verse 8 makes sense as to why He would have to tell them to leave off the celebration and go back to their tents.
This passage is all about the First Day of Unleavened Bread, beginning with the night of solemn observance, just after sunset. Unleavened Bread pictures God's deliverance from the environment of sin. It is about what God did and does for us - it is a memorial of His deliverance. But notice where this took place: Verse 37 puts the beginning of the exodus at Succoth. That was the first place they camped after leaving Ramses in Egypt proper.
So, this is a commonality with Tabernacles, because the place the Israelites camped for the First Day of Unleavened Bread is what this feast is named after. The Jews call this Feast Sukkot, which is the Hebrew word for tabernacle, tent, or booth. And the name of the first place the Israelites camped is Succoth, which is the same word, except that it is plural. So, the Israelites stayed in booths in Succoth. This is curious because they stayed in booths in the place that had already been named booths. It was already named Succoth when they got there and made their camp. The backstory to this is found in Genesis 33:17:
So, the place the Israelites camped for the First Day of Unleavened Bread was named after the dwellings Jacob made for his livestock. Therefore the name of the place is called Succoth.