Here's what i found about the subject of the history of Muslims in France.
Muslims in France from wiki-
As mentioned, they were far more successful in what is nowadays part of Spain *and* Portugal, taking advantage of the chaos in those regions (constant civil wars), and establishing a solid hold there...until the Christian kingdoms in the North went crusader/inquisition mode.
After their conquest of Spain, Muslim forces pushed into southern France. They were defeated at the Battle of Tours in 732 but held Septimania until 759.
In the 9th century, Muslim forces conquered several bases in southern France, including Fraxinet. They were expelled only in 975.[20]
Barbarossa's fleet in Toulon.
During the winter of 1543–1544, after the siege of Nice, Toulon was used as an Ottoman naval base under the admiral known as Hayreddin Barbarossa. The Christian population was evacuated, and Toulon Cathedral was briefly converted into a mosque before the city was regained by France.
After the expulsion of the Moriscos from Spain in 1609–1614, about fifty thousand Moriscos entered France, according to the research of Henri Lapeyre.[21]