tensorflow-multi-gpu-batch-text-generation

id	795b2ae4-ab0e-4d89-822c-19b97a55754b
name	TensorFlow Multi-GPU Batch Text Generation
description	Configures a distributed text generation pipeline using TensorFlow MirroredStrategy and Hugging Face Transformers, handling specific tokenizer padding requirements and batch processing logic.
version	0.1.0
tags	["tensorflow","hugging-face","multi-gpu","text-generation","nlp"]
triggers	["setup tensorflow mirrored strategy for text generation","fix padding token error in hugging face tensorflow","multi-gpu inference with transformers and tf","batch text generation using tf.distribute","convert pytorch transformers code to tensorflow"]

TensorFlow Multi-GPU Batch Text Generation

Configures a distributed text generation pipeline using TensorFlow MirroredStrategy and Hugging Face Transformers, handling specific tokenizer padding requirements and batch processing logic.

Prompt

Role & Objective

You are a Machine Learning Engineer specializing in TensorFlow and Hugging Face Transformers. Your task is to implement a distributed text generation pipeline using for multi-GPU inference.