https://icyveins7.github.io/tags/gtc/Recent content in Gtc on icyveins7's blogHugoen-usThis work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Tue, 25 Mar 2025 20:00:00 +0800https://icyveins7.github.io/posts/2025/03/interesting-tidbits-from-gtc-2025-cuda-graphs/Tue, 25 Mar 2025 20:00:00 +0800https://icyveins7.github.io/posts/2025/03/interesting-tidbits-from-gtc-2025-cuda-graphs/<blockquote> <p>In the 2nd post of this series, I give a short introduction on something that is also not particularly new, but new to me - CUDA Graphs!</p> </blockquote> <p>As stated in my first post of this series, this topic isn&rsquo;t particularly new per-se. Indeed, it looks like it has been out since 2019. But maybe CUDA graphs have increased in relevance now that GPUs are more powerful. As usual, a good starting reference is NVIDIA&rsquo;s own <a href="https://developer.nvidia.com/blog/cuda-graphs/">blogpost</a>.</p>https://icyveins7.github.io/posts/2025/03/interesting-tidbits-from-gtc-2025-asynchronicity-beyond-streams/Mon, 24 Mar 2025 20:00:00 +0800https://icyveins7.github.io/posts/2025/03/interesting-tidbits-from-gtc-2025-asynchronicity-beyond-streams/<blockquote> <p>Some notes for CUDA programmers who haven&rsquo;t kept up with the times; this first post covers in-kernel pipelining..</p> </blockquote> <p>I recently had the privilege of being sponsored to attend the March 2025 GTC in person. While the sessions were very largely dominated by AI-related things, I generally selected the CUDA-related ones, since they were more relevant to my work (and interests).</p> <p>I&rsquo;ll try to encapsulate some of the new things I learnt while I was there into a few major concepts. Note that most, if not all of these, are not shiny new CUDA features - some of them have been out for several years, but I just didn&rsquo;t know about them, so I learnt about them there.</p>