The pipe dream is having memory, cpu and gpu all interleaved in a single coponent, or the whole gpu being made of building blocks (think memristor) that can both compute and store data. Having data and computing resources all together would greatly reduce the memory access bottlenecks that plague modern systems.