I've become fascinated by GPUs because I realize they are thousands of little mini-CPUS, which is an architecture that resembles the brain. I wonder how they can push this further and explicitly make a chip that has as many interconnections as possible between extremely simple processors. Like, fabricate a completely new type of CPU, it doesn't have to be fast or complex, but it should maximize BANDWIDTH between the different little cells. That's how the brain works: with 100 billion neurons, each one connected to between 1-10,000 other neurons via synapses. Estimated 1,000 trillion synapses. How can we fabricate a chip that comes close to this amount of interconnection? 3D overlaid connections? lots of little subsections that are super-duper-interconnected? it doesn't have to resemble the biological brain in anything except this general topological feature of super-interconnection. probably intelligence will arise if we can do this.

i.e. neuromorphic chip

https://johnkoetsier.com/artificial-brain-neuromorphic-chip/

So computers of the future will likely be microservices architecture housed in data centers, which will have terminal connections to traditional computers housed on smartphones and laptops. And the computer in the datacenter will actually be thousands of computers of different architectures: neuromorphic for analog neural networks, traditional von Neumann CPUs, GPUs for parallel processing, and quantum for some specialized tasks.

Imagine a "brain" with access to all of these different types of computing, and with access to huge amounts of storage, of different latencies (super-fast, and slower for lots of other stuff), and networked into the internet.