Yes, it's going to be an issue. 22ga or 24ga are optimal. If you'd like more reasons, the biggest is how the cables are typically made - twisted batches of multiple strands.
Electricity takes the path of least resistance, and an AC signal is going to travel on the "skin" of each strand (typically). This is, in part, due to valence electrons. But the real issue arises due to the parts (frequencies) which don't see the outermost surface as least resistance. This will skew the signal.
There are white papers on this (some written by FEMALES, FYI), which describe this in greater detail.
The best conductor for RCAs (imho) is 22 or 24ga solid-core copper. It's a single "strand," has low eddy current due to low mass, and the small gauge is optimal for signal flow. (You'll get people who claim you will break solid-core RCAs in a car, but as long as you're not bending them repeatedly, or straining them by trying to pull them through an opening or under carpet by the ends, solid cores are fine.)
Source: I literally build and sell RCAs, and have customers in IASCA, as well as home audiophiles in several countries who swear by my products.
FYI, Belden makes a very good 24ga solid core cable, all copper, which is shielded. If you need some to DIY your cables, I have about 10 miles of it and Audioquest 22ga on spools. Feel free to PM me.