https://www.etymonline.com/word/cracker
Yeah, let me google that for yah
Southern U.S. derogatory term for "poor, white trash" (1766), probably an agent noun from crack (v.) in the sense "to boast" (as in not what it's cracked up to be). Cracker "a boaster, a braggart" is attested from c. 1500; also see crack (n.). Compare Latin crepare "to rattle, crack, creak," with a secondary figurative sense of "boast of, prattle, make ado about."
I should explain to your Lordship what is meant by crackers; a name they have got from being great boasters; they are a lawless set of rascalls on the frontiers of Virginia, Maryland, the Carolinas and Georgia, who often change their places of abode. [letter from colonial officer Gavin Cochrane to the Earl of Dartmouth, June 27, 1766]
Thanks for the reference! Doing more reading I think the thing that really convinced me was this:
An example of this can be seen in William Shakespeare's King John (c. 1595) "What cracker is this same that deafs our ears with this abundance of superfluous breath?
That predates American slavery by a full generation
(post is archived)