Union Church is an unincorporated community located in Jefferson County, Mississippi, United States. It was a settlement of Scottish people. The community of Union Church was formed primarily by a group of Scotch settlers who left North Carolina around 1805 for the promise of fertile land to be farmed on the eastern banks of the Mississippi River…Union Church is an unincorporated community located in Jefferson County, Mississippi, United States. It was a settlement of Scottish people. The community of Union Church was formed primarily by a group of Scotch settlers who left North Carolina around 1805 for the promise of fertile land to be farmed on the eastern banks of the Mississippi River. The town was originally called Scotch Settlement. The founding families were headed by George Torrey, his son Dougald Torrey, Laughlin Currie and Robert Willis.