AWS put out a video and article on how it recycles a large amount of its hardware, since it is built for maintainability and repairability.
How true is that? Does it apply to other datacenter operators as well?
What will happen to all the parallel compute cards that will get upgraded soon? They can't be reused as GPU's for gamers, can they?
Sticks of ram will certainly be resold, custom aws motherboards - not so much.
I have seen custom (unpublished) intel cpu parts on ebay before which are almost certainly aws's custom ones.
Almost nothing will get used by consumers - enterprise server gear is designed for heat/air speed/noise/energy cost requirements which are incompatible with consumer requirements. It's recycled only in the sense that a smaller business might be interested in it because at the end of its economic life its now cheap to buy (but not cheap to run).
You're right; V100/A100/H100 "GPUs" do not have the hardware to display graphics and they generally require custom SXM motherboards. Most of them will sit on eBay for a while and then be scrapped when no one buys them.