![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_092448-1-1024x461.jpg\")
So<\/h2>\n\n\n\n
I have a love-hate relationship with Thunderbolt. Last time<\/a>, I wrote a rant about my failed attempts to build a home server using this cursed technology.<\/p>\n\n\n\n Apparently, I forgot to untick the “unlist” button I have set up in WordPress back then?? So almost two months after posting that article, the only people who read it are those I directly sent it to?? Whoops.<\/p>\n<\/blockquote>\n\n\n\n I remain convinced that Thunderbolt is an technology completely unsuited to practical, serious workloads. However<\/em>, that definition does not extend to absurd setups which are more art than work…<\/p>\n\n\n\n When I was still a Thunderbolt believer in 2021, I purchased this PCIe Add-In Card.<\/p>\n\n\n\n The Titan Ridge is a Thunderbolt controller card that connects over a PCIe 3.0 x4 link. Once plugged in, this card offers two Thunderbolt 3 ports. The back of the card has a few more connectors, all of which the instruction manual states must be attached to operate:<\/p>\n\n\n\n Right to left:<\/p>\n\n\n\n There’s something else we need to discuss about Thunderbolt before proceeding to the question. As I mentioned in the last article, Thunderbolt is a physical connection layer that lets one tunnel PCIe traffic over a USB-C cable. The speed of Thunderbolt 3\/Thunderbolt 4 is PCIe 3.0 x4.<\/p>\n\n\n\n Certain (pricey!) adapters recognize this capability and the flexibility of PCIe to expose an outright PCIe connector at the end of a Thunderbolt connection. This can range from a simple adapter for NVMe SSDs<\/a> (which are also just PCIe devices, in a different connector) to outright PCIe slots like those found on motherboards. This is the backbone of the “external GPU” or “eGPU” concept– the promise that PCIe can be had via an easily accessible connector which would allow one to connect a full-size desktop GPU to their laptop. There’s a whole forum dedicated to ecking the most performance possible out of eGPUs over at egpu.io<\/a>.<\/p>\n\n\n\n There are three problems with eGPUs that prevent them from going mainstream:<\/p>\n\n\n\n Now we have all the necessary info (and fun facts) necessary to pose the question:<\/p>\n\n\n\n The Titan Ridge card creates a Thunderbolt 3 link given a PCIe 3.0 x4 interface. An eGPU connector provides a PCIe 3.0 x4 interface given a Thunderbolt 3 link. Could it be possible to drive one off the other in a demented daisy-chain? Could I create a Thunderbolt-over-Thunderbolt connection?<\/p>\n\n\n\n This past weekend, I was finally able to answer this question thanks to the monthly flea market. An individual tabling sold me a barebones eGPU enclosure for $80.<\/p>\n\n\n\n The enclosure requires an ATX power supply to operate, so I ran over to another booth and picked up a spare one for $10. Then I got home and the magic began.<\/p>\n\n\n\n My victim machine was a ThinkPad T480s, purchased the same day to replace another laptop whose soldered RAM had failed the previous week.<\/p>\n\n\n\n A sanity check was in order first to ensure that the enclosure worked. I plugged in a spare GPU, an AMD Radeon Pro WX 2100<\/a>. Sure enough, the GPU came up and output to a display, no problem!<\/p>\n\n\n\n Moving on, could I get the Titan Ridge card to work? What about that special connector we need to attach to the motherboard?<\/p>\n\n\n\n Turns out the connector is completely unnecessary for the card to operate correctly. Years ago, someone posted a very simple solution: Just bridge pins 3 and 5 of the connector, and it’ll work in any motherboard<\/a>. <\/p>\n\n\n\n I wired up the 6-pin PCIe power connectors, but didn’t have the cables necessary to connect the USB headers (I would have needed something like this<\/a>.) Might as well try anyway, right…?<\/p>\n\n\n\n It just worked. I quickly grabbed a ThinkPad Thunderbolt dock and plugged in some devices, then attached the dock to the card.<\/p>\n\n\n\n It worked. It just worked. I couldn’t believe it. I almost choked myself with laughter. Not a single piece of debugging was necessary, just a lot of checking cables and rebooting. I had no clue how this unholy contraption wasn’t catching fire, let alone functioning correctly, but it was.<\/p>\n\n\n\n I’m guessing those USB headers were to facilitate plugging USB-C devices directly in to the port; when I tried to directly attach a flash drive, nothing happened.<\/p>\n<\/blockquote>\n\n\n\n The primary use case for Thunderbolt is laptop docks. On top of PCIe traffic, Thunderbolt can transmit USB and DisplayPort traffic at the same time, muxing each data stream together. Thunderbolt controllers integrated into laptops have a DisplayPort output from the GPU routed into them, but the Titan Ridge card doesn’t have that luxury, being a “normal” PCIe device. It therefore provides two mini-PCIe input ports, one for each Thunderbolt port, and some mini-DP to DP cables to plug in to your GPU.<\/p>\n\n\n\n In order to get display output working under this card, we’ll need to get a DisplayPort connection to these ports. I started with a cheap, $20 USB-C to DisplayPort adapter I had lying around.<\/p>\n\n\n\n This seemed to work, but only at 1080p@60hz. My display is 1440p@144hz, and this setup only got a black screen with occasional flickers at that resolution. Bad connection? Crummy adapter? <\/em>Either way, a better idea presented itself with two facts:<\/p>\n\n\n\n So, I could take the second Thunderbolt dock, attach it to the PCIe enclosure, and use its DisplayPort output to reroute to the Titan Ridge display input, which would then drive a display over the first Thunderbolt dock all the way to my monitor.<\/p>\n\n\n\n Here’s a delusional diagram of this demented setup:<\/p>\n\n\n\n And yes, it works.<\/p>\n\n\n\n As I write this, I’m still shocked that instead of opening a portal to a Lovecraftian horror dimension, this absurd setup just worked as expected. What more is there to say?<\/p>\n\n\n\n Well, we could try going in the other direction.<\/p>\n\n\n\n The answer to this is much closer to what I was expecting.<\/p>\n\n\n\n I attempted this setup with two motherboards- an old Gigabyte GA-Z170P-SLI with an Intel i5-6500 in it, and my daily driver, the Gigabyte X570 Aorus Pro with a Ryzen 9 3950X. <\/p>\n\n\n\n The Intel board did not cooperate with the Thunderbolt card at all. Despite having a Thunderbolt header, the card refused to start unless I bridged the header as shown earlier. It then displayed a variety of symptoms, most often doing nothing but occasionally crashing or failing to POST. Eventually the behavior settled to “it crashes on hotplugging the enclosure, but if you try to boot with it plugged in the PCIe bus goes out to lunch”:<\/p>\n\n\n\n The X570 was the board I purchased this Thunderbolt card for originally. I daily drove it for a few years to use a Thunderbolt dock. I was able to bring up an NVMe drive with the enclosure attached without too much trouble (only a handful or reboots and kernel command-line changes– about par for the course with Thunderbolt) but my AMD GPU stubbornly refused to boot. Checking the dmesg logs, this appeared about 30 seconds after power on:<\/p>\n\n\n\n This led me to this open bug report<\/a>, which pointed out that, as I said earlier, that hot-plugging GPUs generally doesn’t work. Clearly my GPU was attempting to attach after boot and therefore failing.<\/p>\n\n\n\n However, this motherboard has full awareness of Thunderbolt including BIOS options for it. By settings the “USB Type-C with Titan Ridge Boot Support” to enabled, I got the BIOS to detect the Thunderbolt-attached PCIe device on boot, and it came up successfully.<\/p>\n\n\n\n So, not nearly as instantly functional as the other way around, and it only really works with help from the BIOS. But hey, I did get it working!<\/p>\n\n\n\n Certain people in my life continuously tell me that I’m cursed. I think they’re right– I can’t reliably use a computer without it breaking in some fashion or another.<\/p>\n\n\n\n The nature of the curse, at least this year, seems to be “you cannot use a computer without it breaking, but you can construct Rube Goldberg machines worth over $900 at MSRP to force signals to travel further than reasonable and it’ll just work”.<\/p>\n\n\n\n I wonder what would happen if I bought another eGPU enclosure and continued the chain further. Lightning strikes… Then strikes again. And again. The gods are trying to smite me<\/p>\n","protected":false},"author":1,"featured_media":272,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-247","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/posts\/247","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nocoffei.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=247"}],"version-history":[{"count":0,"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/posts\/247\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nocoffei.com\/index.php?rest_route=\/wp\/v2\/media\/272"}],"wp:attachment":[{"href":"https:\/\/nocoffei.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=247"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nocoffei.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=247"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nocoffei.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\n
The Instigator<\/h2>\n\n\n\n
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/image.png\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/image-1.png\")
<\/figure>\n\n\n\n\n
More Thunderbolt talk<\/h2>\n\n\n\n
\n
What happens if I plug my Thunderbolt Add-In Card to an eGPU connector?<\/em><\/h2>\n\n\n\n
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240721_215607-768x1024.jpg\")
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240721_215512-768x1024.jpg\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240721_220251-1024x462.jpg\")
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/Screenshot_20240721_222109-1024x576.png\")
<\/figure>\n<\/div><\/div>\n<\/div><\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240721_220724-1024x768.jpg\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240721_222451-1024x768.jpg\")
<\/figure>\n<\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/Screenshot_20240721_222516-1024x576.png\")
<\/figure>\n<\/div><\/div>\n<\/div><\/div><\/div>\n\n\n\ndmesg<\/code> showed a very lengthy bringup process and lspci<\/code> showed the controller fully present and online.<\/p>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_082125-1024x768.jpg\")
<\/figure>\n<\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/Screenshot_20240722_081747-1024x576.png\")
<\/figure>\n<\/div><\/div>\n<\/div><\/div><\/div>\n\n\n\n\n
What about display output?<\/h2>\n\n\n\n
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/titanridgearrow.jpg\")
<\/figure>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_091300-1024x768.jpg\")
<\/figure>\n\n\n\n\n
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/the_chain.png\")
<\/figure>\n\n\n\n<\/figure>\n<\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_092806-1024x768.jpg\")
<\/figure>\n<\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/Screenshot_20240722_092502-1024x576.png\")
<\/figure>\n<\/div><\/div>\n<\/div><\/div><\/div>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/announcer.jpg\")
<\/figure>\n\n\n\nWhat else?<\/h2>\n\n\n\n
What happens when you attach an eGPU enclosure to a Thunderbolt card?<\/em><\/strong><\/h2>\n\n\n\n
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_121712-1024x768.jpg\")
Nov 27 12:23:32 a kernel: [drm:amdgpu_bo_init [amdgpu]] *ERROR* Unable to set WC memtype for the aperture base\nNov 27 12:23:32 a kernel: [drm:amdgpu_device_init.cold [amdgpu]] *ERROR* sw_init of IP block <gmc_v10_0> failed -22<\/code><\/pre>\n\n\n\n![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/IMG_20240722_144643-1-1024x768.jpg\")
![\"\"](\"https:\/\/nocoffei.com\/wp-content\/uploads\/2024\/07\/gymnastics-1024x1024.jpg\")
<\/figure>\n\n\n\nConclusion<\/h2>\n\n\n\n
![\"\"\/](\"https:\/\/imgs.xkcd.com\/comics\/laptop_issues_2x.png\")
Alternatively, https:\/\/xkcd.com\/1316\/<\/a><\/em><\/figcaption><\/figure>\n\n\n\n
<\/p>\n","protected":false},"excerpt":{"rendered":"