All V6 have the larger front brakes. All with 3rd row (all engines) have larger front brakes. My rinky-dink FWD 2-row 4-cyl has the smaller front brakes. I’ve not had a concern with it’s stopping distance at any time, except when my OEM tires were half worn. If I was to continue using the RAV for yard work and utility towing, I’d consider upgrading the front brakes, but there’s more to it. The system differs with pads, rotors, calipers, and the master cylinder with a different proportioning valve. This will make the system work as intended. I think that simply swapping the front pads, rotors, and calipers will result in heavier braking by the front wheels, without having enough force going to the rear to balance it out (hence the different master and valve). This would likely only be a concern under panic stop conditions (but that’s when you most want it to work right!). One or two members here have changed out their small front hardware without doing the master and valve, and have not yet reported any ill effects. As for me, I just picked up a 2000 Ranger as a spare/project vehicle so the RAV has been retired from towing/reno duty. Have a search for it, but I can’t think of a string which will quickly pull results for you. Apparently the large/small brake thing was simplified in the 4.4 by using small brakes on the LE and larger brakes on all other trims, XLE and above.
Again, I have no concerns about the braking performance of my RAV. It’s possible to get better-performing friction materials in the stock sizes too