Should I migrate every product at once?

Usually yes for a small catalog, but larger sites may benefit from rebuilding one category first so the team can test layout, filtering, and product detail rules before importing everything.