A CUDA-MPI Hybrid Bitonic Sorting Algorithm For GPU Clusters

Document Type

Conference Proceeding

Publication Date


Published In

41st International Conference On Parallel Processing Workshops


We present a hybrid CUDA-MPI sorting algorithm that makes use of GPU clusters to sort large data sets. Our algorithm has two phases. In the first phase each node sorts a portion of the data on its GPU using a parallel bitonic sort. In the second phase the sorted subsequences are merged together in parallel using a reduction sorting network implemented in MPI across the cluster nodes. Performance results comparing our sorting algorithm to sequential quick sort yield speed-up values of up to 9.8 for sorting 4GB of data on a 32 node GPU cluster. We anticipate even better speed-up values using our algorithm on larger data sets and larger sized clusters.

Published By



41st International Conference On Parallel Processing Workshops

Conference Dates

September 10-13, 2012

Conference Location

Pittsburgh, PA

This document is currently not available here.