Parallel programming can be intimidating, but doesn't need to be! There's a new paradigm for parallel programming that's newcomer-friendly, highly productive, and performant: tile-based programming models.
In this example-driven talk, we'll introduce you to tile-based programming in Python, C++, and Rust. We'll present [cuTile](https://www.google.com/url?q=https://github.com/NVIDIA/cutile-python&sa=D&source=calendar&usd=2&usg=AOvVaw1U9L1xM_FSG2UPihrmruhb) NVIDIA's new tile programming stack and [Tile IR](https://www.google.com/url?q=https://github.com/NVIDIA/cuda-tile&sa=D&source=calendar&usd=2&usg=AOvVaw2i7eJTrVn4-6QPa8GbtGUI) the new compiler stack that it is built with. You'll learn all about new features of CUDA Tile that have recently been announced, including multi-GPU communication, interoperability with traditional CUDA SIMT, and support for more diverse kernels like convolutions and stencils. We'll compare and contrast tile-based models with traditional parallel programming models. You'll see examples from a variety of domains, including HPC stencils, a sparse matrix vector (SPMV) and conjugate gradient (CG) solver, and AI models from [TileGym](https://www.google.com/url?q=https://github.com/NVIDIA/TileGym&sa=D&source=calendar&usd=2&usg=AOvVaw2MAgFmLATIJtK0x_sEAUxh).
Tile programming has its roots in HPC libraries, such as [NWChem’s TCE](https://www.google.com/url?q=https://nwchemgit.github.io/TCE.html&sa=D&source=calendar&usd=2&usg=AOvVaw1PgogZPefjY8THYetQV0TM), [BLIS,](https://www.google.com/url?q=https://github.com/flame/blis&sa=D&source=calendar&usd=2&usg=AOvVaw2mzDUuCrsvUyDPu-QHccvl) and [ATLAS](https://www.google.com/url?q=https://math-atlas.sourceforge.net/&sa=D&source=calendar&usd=2&usg=AOvVaw1KfoPAfLFEg7QbzsEozrng)
. In recent years, this paradigm has grown in popularity for GPU programming in languages such as [Triton](https://www.google.com/url?q=https://openai.com/index/triton/&sa=D&source=calendar&usd=2&usg=AOvVaw32WPaUabkV_H1arHbNqAt5), [JAX/Pallas](https://www.google.com/url?q=https://docs.jax.dev/en/latest/pallas/index.html&sa=D&source=calendar&usd=2&usg=AOvVaw0DMdnf0oNiIk-7La8XudSq), and [Warp](https://www.google.com/url?q=https://nvidia.github.io/warp/modules/tiles.html&sa=D&source=calendar&usd=2&usg=AOvVaw1U8D9DNFTh73Jt3NYWNfAQ).
In this session, you'll:

* Learn the best practices for writing tile parallel applications for GPUs.
* Gain insight into the performance of tile code and how it actually gets executed.
* Discover how to reason about and debug tile applications.
* Understand the differences between tile and traditional parallel programming and when each paradigm should be used.
* See how tile programming makes your software portable in light of recent hardware trends.

By the end of the session, you'll understand how tile programming enables more intuitive, portable, and efficient development of high-performance, data-parallel applications, for HPC, data science, and machine learning.

**About the Presenter**
Bryce Adelstein Lelbach has spent over a decade developing programming languages, compilers, and libraries. He is passionate about parallel programming and strives to make it more accessible for everyone.
Bryce is a Principal Engineer at NVIDIA, where he founded the Core C++ Compute Libraries team and now leads the Vanguard Programming group that drives NVIDIA's roadmap for programming languages, compilers, and core libraries.
He is a leader of the systems programming language community, having served as chair of the C++ Library Evolution and the US programming language standards committee. He has been an organizer and program chair for many conferences over the years. On the C++ committee, he has worked on concurrency primitives, parallel algorithms, senders, and multidimensional arrays.
He previously worked at Lawrence Berkeley National Laboratory and Louisiana State University. He is one of the founding developers of the HPX parallel runtime system.
Outside of work, Bryce is passionate about airplanes and watches. He lives in Midtown Manhattan with his girlfriend and dog.

C++TO The Toronto C++ User Group

Michael Daum

Francesco Iorio

Naveed Gazi

simonchen24601

Meshwa

Kalman Szenes

Ali A

Mykola Sharhan

simon

(GlobalCpp) Tile Programming for GPU's

Online event

**Description**

Parallel programming can be intimidating, but doesn't need to be! There's a new paradigm for parallel programming that's newcomer-friendly, highly productive, and performant: tile-based programming models.

In this example-driven talk, we'll introduce you to tile-based programming in Python, C++, and Rust. We'll present [cuTile](https://www.google.com/url?q=https://github.com/NVIDIA/cutile-python&sa=D&source=calendar&usd=2&usg=AOvVaw1U9L1xM_FSG2UPihrmruhb) NVIDIA's new tile programming stack and [Tile IR](https://www.google.com/url?q=https://github.com/NVIDIA/cuda-tile&sa=D&source=calendar&usd=2&usg=AOvVaw2i7eJTrVn4-6QPa8GbtGUI) the new compiler stack that it is built with. You'll learn all about new features of CUDA Tile that have recently been announced, including multi-GPU communication, interoperability with traditional CUDA SIMT, and support for more diverse kernels like convolutions and stencils. We'll compare and contrast tile-based models with traditional parallel programming models. You'll see examples from a variety of domains, including HPC stencils, a sparse matrix vector (SPMV) and conjugate gradient (CG) solver, and AI models from [TileGym](https://www.google.com/url?q=https://github.com/NVIDIA/TileGym&sa=D&source=calendar&usd=2&usg=AOvVaw2MAgFmLATIJtK0x_sEAUxh).

Tile programming has its roots in HPC libraries, such as [NWChem’s TCE](https://www.google.com/url?q=https://nwchemgit.github.io/TCE.html&sa=D&source=calendar&usd=2&usg=AOvVaw1PgogZPefjY8THYetQV0TM), [BLIS,](https://www.google.com/url?q=https://github.com/flame/blis&sa=D&source=calendar&usd=2&usg=AOvVaw2mzDUuCrsvUyDPu-QHccvl) and [ATLAS](https://www.google.com/url?q=https://math-atlas.sourceforge.net/&sa=D&source=calendar&usd=2&usg=AOvVaw1KfoPAfLFEg7QbzsEozrng)
. In recent years, this paradigm has grown in popularity for GPU programming in languages such as [Triton](https://www.google.com/url?q=https://openai.com/index/triton/&sa=D&source=calendar&usd=2&usg=AOvVaw32WPaUabkV_H1arHbNqAt5), [JAX/Pallas](https://www.google.com/url?q=https://docs.jax.dev/en/latest/pallas/index.html&sa=D&source=calendar&usd=2&usg=AOvVaw0DMdnf0oNiIk-7La8XudSq), and [Warp](https://www.google.com/url?q=https://nvidia.github.io/warp/modules/tiles.html&sa=D&source=calendar&usd=2&usg=AOvVaw1U8D9DNFTh73Jt3NYWNfAQ).

In this session, you'll:

* Learn the best practices for writing tile parallel applications for GPUs.
* Gain insight into the performance of tile code and how it actually gets executed.
* Discover how to reason about and debug tile applications.
* Understand the differences between tile and traditional parallel programming and when each paradigm should be used.
* See how tile programming makes your software portable in light of recent hardware trends.

By the end of the session, you'll understand how tile programming enables more intuitive, portable, and efficient development of high-performance, data-parallel applications, for HPC, data science, and machine learning.

**About the Presenter**

Bryce Adelstein Lelbach has spent over a decade developing programming languages, compilers, and libraries. He is passionate about parallel programming and strives to make it more accessible for everyone.

Bryce is a Principal Engineer at NVIDIA, where he founded the Core C++ Compute Libraries team and now leads the Vanguard Programming group that drives NVIDIA's roadmap for programming languages, compilers, and core libraries.

He is a leader of the systems programming language community, having served as chair of the C++ Library Evolution and the US programming language standards committee. He has been an organizer and program chair for many conferences over the years. On the C++ committee, he has worked on concurrency primitives, parallel algorithms, senders, and multidimensional arrays.

He previously worked at Lawrence Berkeley National Laboratory and Louisiana State University. He is one of the founding developers of the HPX parallel runtime system.

Outside of work, Bryce is passionate about airplanes and watches. He lives in Midtown Manhattan with his girlfriend and dog.

Chicago C/C++ Users Group

Rob Douglas

sreekanth 

Brandon Robinson

Meysam Zare

Igor L

Yang Yang

Oussama

Imran Javaid

Rich Holm

Matthew Farley

Warren Mo

jess.ding.77

Pritam Kumar Pratihari

Tom Tzad

Vishal Oza

Manikantan Chandran

(GlobalCpp) Tile Programming for GPUs

Global C++

Groups

{PRO_NETWORK_NAME} is on Meetup Pro with more than {PRO_MEMBER_COUNT} members across {PRO_GROUP_COUNT} Meetups worldwide. Meetup Pro is the professional tool for organizing and communicating a network of users, partners, contributors and members.

Global C++ is a network of C++ user groups worldwide

Dušan Jovanović

Global C++

Who we are

Upcoming events

Who we are

Groups