Tutorial: High-performance Inferencing with Transformer Models on Spark

Follow the full discussion on Reddit.
I found it hard to find code examples that distribute inferencing of large neural networks on multiple GPUs instances. So I wrote a tutorial to show others a convenient way of doing it: https://towardsdatascience.com/high-performance-inferencing-with-large-transformer-models-on-spark-beb82e71ecc9