FarSkip-Collective
by AMD · Technique · Text & code
Overlaps expert-parallel GPU data exchange with compute; AMD reports 12.7% shorter pre-training and up to 39.2% lower time to first token
by AMD · Technique · Text & code
Overlaps expert-parallel GPU data exchange with compute; AMD reports 12.7% shorter pre-training and up to 39.2% lower time to first token