The panel I'm looking at: 12-Port Cat6A Shielded Wall Mount Patch Panel I do not have experience punching cable, so am I setting myself up for frustration? (The cable is Cat5e.) ...

A 5- or 8-port switch is likely to give you what you need (especially if you're terminated on patch panels so you can easily patch jacks in when needed), and will have no problem fitting in the ...