Ours were mostly tenent farmers working on the farms of other, larger land owners. Some of the sons married into these families.
I worked with a researcher in Atlanta years ago and the other explanation we got on the name was that Pannell/Panell was a variation of paynelle which was a French term for
Pagan worshiper. Apparently the name was used for some of the original Celts as well as for Africans brought to the South through New
Orleans