I have seen over the years four distinctive trim descriptors for the Rav4: black, dark gray, shadow gray and bluish gray. So, yes, there are different interior trim colors.
Maybe the following info could help you though:
Place your full VIN on the appropriate space in t o y o d i y "select your car" page.
Look in "Vehicle characteristics" for your "Trim code".
The first letter should be "F" (fabric) or "L" (leather) followed by another letter and two digits.
These digits represent the color of the interior trim plastics. The first denote the color, the second the "hue" of the color.
For example, FY12 has fabric seats and (either shadow or dark, haven't been able to find a non-conflicting decoding guide yet) gray interior.
To cut a long story short, if the junkyards you are planning to visit have the ability to relay the VIN numbers to you, you could easily cross-reference their trim codes (the last two digits) against your own and save yourself from unnecessary trips.