Such a system is scalable to 512,000 chips. Each chip has 256 tDSP cores. 6ns latency. 320 GB/s outbound.
“If you look at the human brain with its 200 billion neurons, each connected to maybe 10,000 to 100,000 neurons, it’s the most efficient approach to computation we know. That was our starting point, and that’s the reason the Lambda fabric is different than other architectures—it’s digital, not neuromorphic, but it is based off the same principles as the mammalian brain.”
http://www.nextplatform.com/2016/06/06/former-nasa-exec-brings-stealth-machine-learning-chip-light/